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% Introduction 

The Radio Mathematics Project of the Institute for Mathematical 
Studies in the Social Sciences (IMSSS) has been funded by AID to design, 
implement, and evaluate, in collaboration with personnel of a developing 
country, a system for teaching elementary toathematics by radio. Th^ 
objectives of^^ the project, as described in the initial contract with 
AID, are to: ' ' ^ 

1. develop and test a cost-effective prototype system of radio 
mathematics instruction for elementary grades in a less- 

. developed country tfiat could, with mihor adaptations, be 
used in many less-developed countries; 

» 

2. develop a methodology for producing rad'ib instructional 
materials based on the rapid and specific reporting of 
previous student performcince back to the materials developers; 

3- begin a program of research on major variables affecting 
learning through radio; 

4. help build capabilities in an appropriate host institution^ 
that would enable the institution tp continue or even V 
expand the project with minimal further assistance Vrom 
external experts. 

During its first year, July 1973 to July 1974, the staff selected 

Nicaragua as a project site from among the twelve countries that expressed 

an interest in hosting the project (Searle, 1974). In June 1974 three 

Stanford staff members moved to Nicaragua to join two Nicaraguans already 

recruited to work on the project. Shortly after July 1, 1974, an office 

was established in Masaya, Nicaragua. This report describes the 

activities of the ensuing year, during which staff was recruited and 

trained, and work was started with schools in the Department of Masaya. 

1 



The major activities of the year included prepg^fing and administering 
an achievement test to first'-grade students at the end of their^ school 
year, writing and pilot'-testirig a group of six radio lessons, and 
initiating daily radfb lessons in sixteen experimental schools. By 
June 30, 1975, 70 taped lessons had been presented, almost half of 
the first-grade curriculum. 

In Chapter 1 we give a brief overview of the^year's activities 
and indicate the ways in which our activities differed from those 
projected in 197^. Chapter 2 presents' an administrative history of 
the year. Chapt^er 3 covers many aspecJ^s-'-^of the year 's operations la 
the schools, but we^.de^ay to later chapters discussion of the two 
activities for which we are able to present analysis of data, the 
197ij pilot lessons (Chapter ^) and the 197^ first-grade achievement 
test (Chapter 6). ' In Chapter 5, we examine in some detail what we 
have learned about teaching by radio. A preliminary cost analysis 
for the project is presented in Chapter 7 and Chapter 8 contains 
discussion of other research activities of the project. Chapter 9 
concludes the rep'ort with a brief summary of our accomplishments to 
date and a tentative calendar for 1975-76. 



Project Calendar 
July 1, 1974 to June 30, 1975 



Jaly 4 

Sejitember 3 - November 13 ^ 
dcto.ber 22 - November 15 



February 12 

February 10, 13, 20, 29 
February 24 
March 3-7 

X 

March 6 
April 7-11 
April 10 ^ 
May 12 
June 19 
June 30 



Office opened' in Masaya, Nicaragua 

Six lessons pilot-tested 

Achievement test administered to 
44 first-grade classes 

Attitude questionnaire given to 44 
teachers of first grade 

First day of 1^975 school year 
Weekly teacher training sessions 



Project mathematics lessons started 
in 16 classes 

Mathematics pretest administered in 
16 experimental classes 

Teacher training session 



Mathematics pretest administered iri 
9 additional classes 

Teacher training session 

Experimental lessons started in 6 
Granada schools 

Teacher training session 



Lesson number 70 presented in 
experimental classrooms 



Chapter 1 
Overview of the Year's Activities 



Pridr to establishing an operational site, the Stanford staff 
developed an elaborate and detailed research plan (Searle, Friend, 
Jamison, Suppes, Tilson and-Zanotti^ 197^). Although still providing 
guidelines for project activities, the plan has been altered in many 
aspects' as we have becomp operational. »^ 

•w- -j^e called for mathematics ijgfesons to start with the middle 

of- first grade. Two justificati^ons /Tor this plan were given. The 

first was that the project office would be opened la June, the middle 

*^ 

of the school year, and if W(e taught all of first grade, we could not 
start lessons until the following February. The second was that we felt 
that the initial stages of mathematics instruction should make heavy use 
of concrete materials and we felt uncertain about how to handle such 
teaching ^y/fadio . 

For both operational and, pedagogical reasons we abandoned 
the plan to begin project ^^.essons in the middle of first grade. 
Operationally, we were unable to begin producing lessons as fast as we 
had hoped. We underestima^ted «the time it would take to locate and set 
up an office and to recruit and train staff members. Thus, although 
Sta^^ord staff arrived in Nicaragua in June, it was August before we 
were .able to begin serious work on the writing of lessons. 

The pedagogical reasons for abandoning the plan were equally 



important. We found from observation of first-grade mathematics 
classrooms thgt many teachers grouped students by ability and taught 
different material to each group, so that by the middle of the year 
there was a very large spread in the difficulty of topics being taught 
in the classroom, fhtis, in €he middle of the school year, some children 
in a classroom were still learning to count to 10 while others were 
•doing simple multiplication exercises. It would be impossible to 
introduce into such classrooms lessons aimed at an appropriate level 
of difficulty. ^ Rather, we felt we must pace the lessons from the 
beginning of the year, to diminish the wide diversity of topics being 
taught. (We' did not feel that the disparity be.tween the activities of 
the "slow!? and "fast" groups was an accurate reflection of the spread 
in ability in the classroom, because we observed that teachers tended 
to spend more time with the fast group, thus continually contributing 
to the disparity in level of activities.) For these operational and 
pedagogical reasons we decided to begin lessons at the beginning of 
first grade afid use the intervening time to experiment With methods 
for teaching with concrete materials and with other aspects of lesson 
construction. 

We used the months of August through November, v 197^, to observe 
classes, recruit and train staff, write*, record and try out a set of 
six radio lessons, work wjtth the computer center to develop data analysis 
programs, assess the mathematics achie^vement level of first-grade 
students, and recruit teachers for the 1975 experimental classes. 



A . ■ 

Curriculum development and planning for the opfenin| of school 

occupi-ed' the months before February, 1975. ^ ^ ^ • 

Our initial research plan called for pilot-testing taped 

lessons' in six classrooms, three from rural and three from urban schools. 

Several factors contrived to increase this number. First, for reaspns 

discussed later, we expanded the rural/urban classification of schools ^ 

to three categories, rural, municipal, and urban, and decided to use 

three schools from each location. Because we were concerned about the 

postponement that would be caused by starting first grade lessons as 

late as February, 1975, we developed a plan to revise Ifessons , 

immediately and present revised versions in different classrooms, one 

\ 

month after initial presentation. Expecting to implement this plan In 
February, at the end of 197^ we recruited 18 teachers to participate 
in pilot-testing. The revision schedule proved to^be ifnworkable 
(because we did not have enous*i trained staff to produce two lessons 
a day)* Nevertheless, we honored our commitment to the teachers we 
had chosen to participate in. the project. ^(This year two experimental, 
teachers share one classroom and another teacher left the district, 
reducing the number of classrooms to 16.) 

In May, at fhe suggestion of the Minister of Education, we 
expanded the project to include six classrooms in Granada, a neighboring 
department. Radio lessons in Granada schools are run without direct 
supervision by project staff. Materials are delivered to the School 
Inspector, who distributes them to teachers. She also provides training 
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for teachers, after consultation. with project staff members in Masaya. , 

Because* worksheets are returned to pur office, we haye -a method of 

assessing, how often the taped lessons are used. 

The 1974 research plan called for lesson development in three 
. . . . / 

phases> During Phase A, lessons were to be pilot tested iq a small 
Aumber 6f classes, major revisions were to be made during Phase B, 
and a summative evaluation carried out in Phase C. Although-we expect 

( 

to continue usirfg three phases, \% are presently considering a 
rearrangement of plans for Phase B and Phase C activities for first 
grade lessons. Although"* plans for ^976^n^ not final, we expect to 
delay a major revision of the first-grade radio lessor^ to Phase C, 
broadcasting lessons already developed. These plans are discussed 
more fully in Chapter 9. 
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/ \ ^ Chanher 2 

Adminis^^rative History of the Year 

. During cur visit to Nicaragua , in March, 197^, Ministry of, 
"Education officials suggested that the project establish offices in 

■ ■ • ' 

t'he Institute de Masaya, a secondary school in downtown Masaya. In 

the inter^im before Stanford staff "arrived In Nicaragua, the' Ministry 

decided tha-t ^"'BStause extensive remodelling would be necessary ,« the 

Institute would be-, an. unsatisfactory site for project offices. 

Therefore, one of the'first tasks of the skeleton staff first assembled 

in June wa^ to locate the project offices in a suitable building. 

• \ * ^ 
In less than a\month we had found and moved into a j)leasant 

three-bedroom hoi;se' oi) the outsl^rits^ of Masaya^/ The ho.use is large 

'enough to accommodate ^ staff of ^5.'* No alterations or renovations were 

needed except for minor work that could be- done as 'time permitted. 

The Ministry of Education' pays for rent aad electricity.; alL other 

costs are paid by the project. . . ^ ^ 

♦ » • *% , « 

Furnishing the qf fices was accomplished in small steps over a , 
period of seven months. Since the^Qfflce opened in^ mid-fiscal^ year , • 
the Ministry had no funds for purchasing new furniture until January, 
1975. In the interim the office was furnished with an assortment 
largely coJ,4ected from two sources. First, we were lent some new 
school furniture that was being reserved for a secondary school under^ . 
construction near Masaya. This consisted mostly of small-sized 
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student desks, but also included several typing tables and, more • , 

Ji .• • • ' 

important, a typewriter. Also, at the Ministry headquarters we found 

' some school and office furniture that had been damaged in the^ 

earthquake. We were given permission to use some of this, which, 

after repair, has proved serviceable. 

These furnishingS'were.adequate for the minimal staff during 

\the first months of operation. In January, 1975 the Ministry provided 

us with a large complement c^f new furniture including 1 1 -desks" with , 

chairs. ^ With the ad(iition o\typewr>Lters and file cabinets purchased 

'^^ith. project funda/T^he office is now adequately furnished for a staff 

:of 2^ 

During the. same period, flrom June 1974 to March 1975, we 
gradually acquired the necessary office machines. 'In addition to 
typewriters we own a Gestetner scanner and mimeograph machine for 
producing worksheets; both, of these were shipped from the U.S» The 
Xerox machine and IBM keypunch machine are both rented locally. The* 
keypunch machine was delivered several months later than promised, 
causing a delay in the planned data collection procedures. 

Standard office supplies— paper , stencils, IBM cards, etc.— 
are purchased locally with tlie exception of a few specia?. items. Almost 
ditl the supplies and. equipment used for radio production and the tape 
recorders and cassettes used in classrooms have been imported. Except 
for some delays in ol-earing customs, we have had few problems keeping 
the Nicaragua office supplied with equipment. 
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The other major ancf^essential pieces of equipment are the 
foiir cars which were purcha3ed in the U.S* All are Ford products: 
two Broncos,, one Maverick, and one Econoline Club Wagon. Because of 
factory and shipping delays, the cars were not delivered ,to„Nicaragua 
until, September, 197^; Until that time we use\l^ vehicle belonging to 
a staff meipber and two rented cars (taxis hired bjr^the day, with driver). 
Except for. one dented roof and one missing. spare tiV^, the project cars 
arrived in good condition and have served adequately since then. We 
have had some difficulty in obtaining <repair parts since the Ford 
dealer in Managua does not stock many of the parts for the models we 
use. At times this has caused some; inconvenience. Fortunately, 
potentially intolerable delays in obtaining replacement parts from the 
U.S. have so far been avoided ; twice , essential parts have been hand- 
carried by staff members from the U.S. whose visits coincided with the 
need for parts. , - 

The vehicles'^ are heavily used, transporting staff members who 
live in Managu£_to_and^jnrom work, ^ncL-dur-ing the ^ehoot--dayi~^of^vl%lirllig 
classes. Each vehicle is fully scheduled for routine school visits 
and unexpected transportation needs presently require a reorganization 
of the car schedule. , 

- Recruiting and training staff members has occupied much of the 
time of the Stanford staff. The first two Nicaraguan staff members, 
Vitalia Vrooman, the co-director, and David Cardoza, a curriculum 
writer, were assigned by the Ministry in March of 197^ and devoted 
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o^r half of their time between March and June to the project. These 
two have proved to be outstandingly good^choices; both have excellent 
background's in mathematics curriculam work. Other competent staff 
members have not been so easy to find. He have now the foundations 
of a good staff, but the effort of recruiting them has been far 
from trivial. 

In recruiting professional staff we have looked for people , 

» 

with an adequate background in education who are also capable of 

learning new professional skills such as making classroom observations 

writing scripts, designing tests, and coding observational data. For 

tasks such as teacher training and test administration we expected to 

find, and did find, a higher level of incoming skills, although some 

training was also necessary in these two categories. 

In curriculum design the problem is most severe. There, are 

few people who have had any experience with curriculum development, and 

noneSfith experience developing curriculum for radio. All of the 

< — — 

curriculum design'^^to^datlelias been handled by the two co-directors and 

one trainee. We were fortunate to have Mrs. Vrooman on the staff — 

her previous experience in related curriculum work is excellent. 

It is not a very happy circumstance, however, to have the directors 

so closely tied to detailed production-line work, and we hope to 

gradually train other people to take over most of this work now that 

many . aspects of it are becoming routinized. We estimate that four to 

six months are needed to provide adequate trainiYig for curriculum work. 



Another skill that requires approximately four months of 
training is scrj.pt writing. One person who was recruited in November 
to be a script writer did not become a fully productive writer until 
February. Another who started in February is just now, in June, doing 
an equitable share of the work without requiring large amounts of 
supervisory time. Both of these writers are quite creative and have 
the additional benefit of several years' experience as classroom 
teachers, which gives them a valuable insight into children, their 
interests, and their ability to understand instructions. In the 
process of finding two people who could be trained as script, writers 
we have interviewed or tried out four times as many. Almost _ all jof_ , 
those whom we tried out and rejected were willing and hardworking, but 
lacked that elusive creativity and ability to manage the language that 
is so necessary in a script writer. A script production staff of three, 
including the Stanford staff member, is barely adequate for maintaining 

our present product ion schedule. Thus, recruiting and tralolnPLJSgLnlRt 

writers continues to be high on our list of priorities. 

In other areas such as classroom observation and teacher 
training our problems have been less severe than in curriculum design 
and script writing. Production of materials (worksheets, teachers' 
guides, cassette copies) caused severe problems during February and 
March, the beginning of the Nicaraguan school year, but are now under 
good control, under the supervision of Juan Jose Montenegro, who is 
also the counterpart director of teacher training* Many of the 



research functions, including classroom testing, are handled by 
Luis Ramirez, the Nicaraguan counterpart for research and evaluation. 
At pi*esent there are 23 Nicaraguans on the staff, 11 professionals 
and the remainder support staff. The organization chart for the 
office -is shown in Figure 1. , 

At the end, of June, 1975, we feel that we have assembled a 
good, congenial, hardworking, and trainable staff, and have only two 
major unsolved problems. We still must hire and train at least one 
more script writer, and we must, relieve the co-directors of much of 
the curriculum design work by expanding the capabilities of other 
staff members. 
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Chapter 3 
Operations in the Schools 

In this chapter we discuss Sur experiences with schools, the 
schedule of lesson presentation adopted for 1975, teacher training, 
pretesting of children, interaction with school personnel, and 
the collection of data about schools and about student background and 
perfoxnnance. 

The project is located in the Department of M?.sc*ya, which is 
approximately 30 kilometers southeast of Managua. The department has 
an area of about 5^3 square kilometers, and is the smallest^of the 
16 departments iri the country. The population is about 9^,0^0 and 
approximately 30,000 people live in the city of Masaya, capital of 
the department. 

There are appro ximately 100 public pri mary school s JLn_Jiie 

department, with roughly 170 first R:rade classes* The Ministry of 
Education characterizes schools as urban if t^hey are located within 
the boundaries of a municipality, otherwise as rural. A comparison of 
several indices of urbanization for the ten siunicipalities in the 
Department of Masaya is shown in Table 1. Two towns, Masaya and 
Masatepe, stand apart from the others on almost all of the indices. 
They have larger pppulatipns and more paved streets, movie theaters, 
banks, and telephones than any of the other towns. Visits to the towns 
supported the conclusion suggested by the data in Table 1, namely that 
Masaya and Masatepe are far more urbanized than the other towns. The 
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project staff therefore decided to stratify schools into three levels, 
calling those in Masaya and Masatepe urban, those in the other eight 
tovms municipal , and the remainder rural. 

The distribution of students among grades for the Department 
of Masaya for 197^ is shown in Table 2. Approximately 37 percent of 
the students are in first grade (this figure rises to 46 percent for 
rural students}. The age distribution for first grade students in 30 
classes is shown in Table 3* The mean age for urban students is 8.2 
year's, that for rural students 8.5 years. 

During October and November of 197^ we selected 18 first-grade 
teachers to participate in pilot- testing of lessons ^f or the 1975 school 
year. We obtained frpm the office of the School Inspector a list of 
teachers who were expected to teach first grade the following year and 
in making choices used information about teachers that had been collected 
from classroom observations during 197^. Several criteria were used. 
We wanted approximately equal numbers of teachers from urban, municipal, 
and rural settings and we wanted teachers who understood the nature of 
the extra burden being placed on them and were willing to accept it. 
The teachers had to be located in schools within a 40-minute drive 
from the project office on roads that are .accessible year-round using 
a il-wheel drive vehicle. A few teachers were asked because we thought 
they were especially good teachers of mathematics and might be able to 
provide us with useful feedback. 



Table 2 





Number of 


Pupils per Grade 






Department 


of Masaya, 197^ 




Grade 


Urban 


Rural 


Total 


i 

i 




2.825 


7, 182 


2 % 


2,502 . 


1>256 


3,758 


3 ^ 


2,201 


832 ' 


3,033 


,4 




550 


2,291 


5 


1,338 


359 


1,697 


6 


1,'l72 


258 ■■ 


1,430 


Total 


13,311 


6,080 


. 19,391 




Table 3 

Age Distribution of First-grade Students 

a 

Test Population 
- Age 





5 


6 7 


8 


9 


10 


11 


12 


13 


14 


15 


Tota] 


Rural 


0" 


» 

11 70 


69 


60 


2l< 


12 


111 


3 


0- 


0 


263 


Municipal 


0 


12 76 


95 


52 


^'15 


16' 


11 


2 


1 


0 . 


310 


Urban 


3' 


13 91 


98 


i<6 


25 


li* 


8 


2 


1 


fo 


301 


Total 


3 


.36 237 262 


158 


9^ 


ii2 


33 


" 7 


2 


0 


87'< 



a 

30 randomly selected classes. 



0 
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During-the long vacation one teacher moved out of the district. 
Two of the teachj5rs selected to participate in the p^ogranTare teaching 
in the same classroom, an unusual situation apparently dictated by the 
physical layout of the school and the size of the first-grade enrollment. 
Thus, this year the experimental population consists of 17 teachers and 
the students in 16 classrooms. 

During the 1974 school year all radio lessons are being recorded 
on cassettes and presented in classrooms using battery-operated tape 
recorders. We ref^r to these lessons here as radio lessons. 

The 1974 school year began in Nicaragua in mid -February. We 
decided not to use radio lessons from the outset, but to provide three 
weeks of 'readiness' material to prepare children for the use of 
workshe.ets and familiarize them with the vocabulary and response modes 
the radio lessons would ask of _ them. For this purpose we prepared 
guides and used training sessions (described below) to acquaint teachers 
with our goals and^methods for thiSL^jset^o f pre -broadcast lessons. 
Although these lessens went well, we do not' think they were necessar^ , 
and expect we^wouIdTh^^^ no problems had we started presenting 
radio lessons immediately. The material presented in three weeks of 
lessons could have been condensed into five radio lessons and next 
year we plan to do this. 

For* the first four weeks during which radioTessons were 
presented we prepared only three a week. This decision was necessitated 
by the inexperience of the production staff, which was simply unable 
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to produce five lessons a week at the outset. We had not prepared ^ 
lessons in advance because of the need to be free to <resppnd rapidly 
to -experience with the earliest lessons* Outlines were prepared Top 
the two weekly lessons that were not taped, and the teachers' guides 
were used to tell teachers what material was to be covered in each 
lesson. 

We now produce a radio lesson for each school day. Because 
the situation arises frequently that one or a few schools will have 
no classes on a day when the rest of' the district is in session, 
we have adopted a policy of lesson presentation that' simulates 
conditions with the radio. That is, we ask teachers not to use lessons 
prepared for a day when they do not meet class. They are asked not 
to change the schedule, and not to present two lessons in one day. 
Lessons are constructed with enough redundancy so that missing one 
day will not (we hope) reduce student performance. 

Teacher training 

Project teachers met weekly for the first month of school, and 
-thene^Tter^jip^^ once every six weeks. To date they have 

partipipated in six^e^her Jtj?aining sessions. The initial get of 
training sessions were designed to acquaiiit teachers with the purposes 
of the project, help them become oriented to their new teachingTxrle,^ 
allow the staff and teachers to become acquainted, explain logistical 
aspeats^of the project, such as distribution and collection of materials 
and the classroom observation schedule, and to present specific teaching 
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plans for the project lessons they were being asked t'o teach. 

Training sessioa^j' we're held at the project offices after school 
and lasted from two to three hours* On the average, 12 of the \7 
teachers/at tended each session. They were joined by the staff -members 
(usually four) who had participated in planning the session and shared 
"the task of running it. The sessic^s focused on the interchange of 
'ideas and experiences, in the format of an open dialogue between all 

•s. 

the participants, giving the teachers the opportunity to express 
themselves as naturally and spontaneously as possible. Several 
principles^ guided the planning of the sessions; that materials presented 
should be directly related to the needs of the teachers, that teachers 
should be active participants in their own learning experience, that 
they should have experience with the materials they are to teach, and 
that they should feel part of the process of .lesson development. 

Teachers participated in many different -activities* During 
the first sessions they played the role of students for a radio lesson 
and worked with the materials the projeat had prepared for the 'readiness 
lessons, developing lesson plans for their own use during this period. 
They designed a worksheet to help them become familiar .with its structure 
and use* By the third session, the emphasis shifted back to the use 
of radio lessons and teachers spent time further defining their new 
role, and thein specific responsibilities before, during, and after the 
radio lesson. In some of the later sessions,' the following specific 

r 

problem areas were examined in Tiore detail; (a) classroom management 
* • ^ 
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concerns, .such as efficient .ways ^of distribqting materials, (b) how 
teachers might work with children of different ability levels, 
especially those who were having the most difficulty keeping up with 
lessons,, and (c) the^ use pf materials— why the use of materials is 
important in teaching basic mathematical concepts, the kind? of 
materials they could use, and how to use them to meet specific 
curricular objectives* . ^ ' 

Part of each training session was. devoted to logistical 
concerns, discussing when materials would be distributed and fibllected 
(lesson materials for a week are distributed the preceding Thursday or 
Friday), how children were to number their worksheets (aAd the 
importance of having the correct student number on each sheet) , and 

r 

when their classes would be tested or observed . Teachers were also 
given practice in using the tape recorder, especially wij^h adjusting 
sound levels, which they tend to set too high, resulting in distortion 
of the sound . - ^ . 

for the project, one of tHe mo^t valuable aspects of' the teacher 
training sessions has been the opportunity to obtain from teacher^ 
information about how lessons are going in their classes. The project 
stafir has strived to maintain positive, close relationships with the 
teachers, not. just to help ensure their cooperation, but also to 
encourage them to express their opinions openly and honestly. As the 
year progresses, ^they Ijave felt increasingly free to criticize, and 
have given us much ^useful' information as a' result. 
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Classroom visitation 

Of the 16 eicp^rimental Classrooms, staff members observe the 
mathematics lesson daily in six, and once a week in five* The remaining 
five classes are not^observed at all. We chose to maintain only limited 
contact with a group of classes so^ that we couy find out what types 
pr problems arise, how well the teacher is able to cope with the 
themV and whether such classes use the recorded lessons as regularly 
as thpse that are observed. /.Teachers of these unobserved classes have 
the opportunity to talk yith a staff member onco^each week when 
materials are delivered and collected. 

In a further attempt to examine utilization of materials in 

* r * 

the absence of staff support, an arrangement was -made with the School 
Inspector of Granada, a neighboring department, to present lessons in 
six classrooms under her supervision, without any contact with project 
staff. Preliminary indications are tha't both tTie unobserved classes 
in Masaya and the* classes in Granada^ are using lesson materials 
regularly, and have not encountered unsurmountable problems with tape 
recorders and les&on "materials. / 

The project method for observing classes has become more 
systematic as the year has progressed. At the beginning of the year 
an observation form was developed to record aspects of ^ the way 
.teachers taught project material without support from radio lessons. 
During ; the first three weeks, teachers were given a guide that 
included suggestions for specific activities, but allowed much 
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flexibility, and we wanted observers to record details of what the 
teachers and children actual!/ did 'during the lessona. The form 
we used was quite simple, providing for a running account of what 
happened in the classroom. 

When radio lessons started we devised a form that identified 
each part of the lesson and asked the observer to comment about the 
folloyjing items for each segment of the lesson: whether instructions 
given by the radio were understood by the children, what proportion of 
the children participated in each activity, whether the observer 
thought the children found the exercises easy or hard, whether the 
children followed the worksheet, how the classroom teacher and 
children handled materials, whether the ma^i?ematics content seemed 
easy or hard and whether the teacher followed the instructions in the 
teachers' guide. 

. Using this form, observers were able to provide considerable 
qualitative information that was quite useful to curriculum specialists 
and script writers. However, the form did not provide quantitative 
data that would allow comparisons between lessons, or of one part of 
a lesson with another. About one month after radio lessons began wg 
revised the observation form again and are now using a slightly 
modified version of this revised form. The fBrm is designed for use 
with both radio and postbroadcast segmercs of the lesson, and uses 
a numerical rating, asking observers to evaluate, using a scale of 
1 to 10, several factors for each portion of the lesson. The factors 
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are the degree of interest displayed by the children, the approximate 
percentage of the children participating, the approximate percentage 
of participating children that are working independently, and a rating 
of how well the children appear to understand the material being 
presented. Observers are also asked to respond to questions posed 
by script writers or curriculam developers about particular segments 
or exercises. The observation form for each day's lesson is prepared 
in advance with each segment identified in such a. way that the 
observer can recognize when it starts, and with the special questions 
typed on the form. 

The staff maintains an on-going training program for observers. 
Pairs of observers visit the same class, and the two observation sheets 
are used during training sessions to clarify and make more reliable the 
use of the rating scales. Each observer participates in this exercise 
at least once a week. % 

First-grade pretest 

For a first-grade pretest we chose to use a modified version 

of the Tests of Basic Experiences (TOBE), published by CTB/McGraw 

« 

Hill, for which there is a Spanish version. We used the Level K 
examination, designed for use with kindergarten children, because most 
Nicaraguan first-grade students have hacj no prior school experience. 



The test booklet contains only pictures, with one exercise on a page. 
The test directions contain two types of verbal material, the geaeral 
directions to the children, and the stimuli (specific directions). 
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one for each item, to which the children respond. 

The Spanish version of the test was designed fcr use vith 
children in the United States, and a change in oral stimulus for a few 
items was necessary ♦ One question asked the children to recognize a 

S, coin, in other cases the Spanish usage was not customary in 
Nicaragua. After these initial changes were made, the lessons were 
pilot tested in two classrooms and further changes were made in items. 
In addition, the general directions were substantially rewritten. 
These changes will be reported in detail in a forthcoming publication 
that will also present an analysis of the test data, obtained. 

The authors of the TOBE test suggest that the Level K form 
be administered in grpups of five or six under carefully controlled 
conditions. We were unable to do this, but we did take special 
precautions to reduce, the level of copying. In some classes we asked 
students to leave (those excused were randomly selected from the 
class list). In many cases, the test administrators rearranged the 
furniture in the classroom and changed the seating pattern of 
students, using books as dividers between students where this was 
possible. While one staff member read the instructions, another 
circulated through the room, encouraging children to work alone. 

The test was given to 537 children in the 16 experimental 
schoo]" and ;to 268 students in 9 schools that were randomly selected 
from aijQong tljiose schools not participating in the project. We 
tested', this latter group to give us information about how different 

1 
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our experimental classes were from a randomly selected set of classes. 

We will posttest this same group of classes but do not plan to compare 

performance of the two groups because the experimental classes were 
not randomly selected.. 



Collection of data about schools and students 

He have found that both the Ministry of Eklucation and the 
School Inspectors Office for the Department of Masaya collect data 
about schools and students, and both of these agencies have been 
very^ cooperative about making information available to the project. 

The Ministry of Eaucation collects, summary data from esch 
of the sixteen departments in the country. Once a year they publish 
a booklet that presents some of this data. The following list 
includes most of the data available about primary schools. The 
booklet contains information on 

1. the number of matriculated students per grade, 

2. the number of students (by grade) that took the 
final examinations and the number that passed, 

3. the number of deserters, 

4. the school-age population, 

5. the number of repeaters by age and grade, 

6. the number of teachers by sex and certificate, 

7. the number of schools and classrooms by type and 

location, public/private/municipal and 
urban/rural, 

8. the number of teachers, by grade and location, 

9. the pupil- teacher ratio by type of school, 

10. a frequency distribution of pupil-teacher ratio 

by location of school, and 

11. the number of teachers and Students in unitary or 

multigraded classes. 

The Inspector's office receives monthly attendance records 

if 



from the schools, and at the beginning and end of the year, 
matriculation figures, and pass-fail infprmation. We have obtained 
the following information about the teachers and schools .with which 
we are working. • ' 

1. Teachers 

a. type of teaching certificate 
^ b. level of formal study 
^ c. years of service 

d. age and sex 

e. marital status and number of children 

2. Schools * 

a. location by barrio 

b. urban/rural by , municipality 

c. public/private/municipal 

d. morning/afternoon/evening sessions 

e. number of classes by grades , 

f. initial matriculation by grade, sex, age 

g. number of repeaters by grade, sex, and age 
b. number that took final examinations 

i. number that passed and failed final examinations 
j. number of deserters by cause (.*»lckness, work, 

conduct, or other) 
k. average monthly attendance by grade 
1. amount of furniture (desks, chairs) 

Information about individual students must be collected 

from the school; no records are kept at the Inspector's office. 

We are presently collecting the following information about students. 



both those in the classes that were given the year-end achievement 
test in 197^ and those in the 1975 experimental classes. 

1. Data by student for year 1 (collected in 1974 and 1975) 

a. date of matriculation 

b. sex 

c. date of birth 

d. school at vrtiich he studied last year 



e. number pf years (or partial years) he has 

attended school 

f . number of yearai, he has repeated 

g. father's occupation 

h. ^dl33tance from home to school 
!• attfilidance — number of days in school per month 
j. vrtiether student took final examinations 

' k. whether student passed the school year 
1. vriiether student passed in mathematics 
m. number of subjects student failed 

2. Data by student for year 2 

a. ^rtiether he retook failed examinations the 

following February • 

b. the outcome of the reexaminations 

c. vrtiether he entered school 

d. v^at grade he entered 

e. vrtiat school he entered 

These data will be used in a study of the determinants of 
miathematics achievement, repetition propensity, and dropout propensity, 
which is described briefly in Chapter 8. . ' 



Relationships with school personnel 

The project staff has attempted to maintain contact with others 
in the school district who are concerne'd with or interested in the 
project. The Inspect -^r provided us with letters of introduction, and 
has asked all school directors and teachers to cooperate with the project 
We keep directors of schools we work with informed of all changes that 
affect their schools. We also send out an information bulletin to 
all teachers in the Department to keep them informed about project 
activities. 

In pur contacts with teachers of experimental classes we 
have stressed that classroom observations and the testing program 
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are not designed to evaluate either teachers or individual students, 
but are for the purpose of improving the instructional program. We 
try never to make evaluative comments to the teachers, except 
occasionally to praise them tor something special. The teachers- 
receive no report from us on how students perform, but we have 
discussed with them ways they can use worksheets themselves to 
evaluate student performemce. The teachers have responded well to 
our' approach and we have encountered none of the resistance we 
anticipated to our intervention in their classrooms. 
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Chapter 4 ' i • 

Curriculum Development and Production ^ ^ 

Design and Testing of 1974 Pilot Lessons 

Preliminary information about many aspects of the design of 
radio lessons was obtained from the administration of pilot radio 
lessons to first-grade classrooms. Two lessons were written, tested, 
in three classrooms, arid then completely rewritten. Four more lessons* 
were produced and all six form the set of pilot lessons described here. 
These lessons were given in six cl as sroom^ during November, 1974, close 
to the end of the academic year. 

The content of the lessons was chosen to provide a variety 
of topics, with at least one topic that was new to the children, 
presented in a coherent sequence of lesson segments.^ 

Several types of responses (oral, written, phys-ical, 
manipulation of materials) were used, to fincj out what the children were 
able to do, what types of instructions were needed, ^pd how much time 
to allow for responding. In addition, we experimented with reinforcement 
by providing answers to some questions after the students had responded. 

Some portions of the lessons were designed to be handled 
entirely by the teachers, sc we could assess the effectiveness of our 
instructions to teachers. We also asked the teachers to motivate the 
lessons and to assist during the broadcast by encouraging the children 
to respond orally and by displaying a sample worksheet. 

We tried to arouse interest in the lessons by using stories 

. " 06 



with lots of action and adventure, augmented by many sound effects. 

The same skeleton cast was used throughout the six lessons and 

additional characters Hfre brought in as needed* 

Lesson COfttent/ The six lessons contained 48 segments, of 

■== ^ ^ 

which 39 were presented during and 9 after the broadcast. Segments 
were chosen from five strands: Number .Concepts (NUM), Applications, 
'(APL), Geometry (GEO), Basic Concepts (BAS), and Addition (ADD), as 
shown in Table 4. Segments from t)ie Basic Concepts strand were used 
to teach students to use the work sheet. (These tasljs were 
nonmathematical, asking the students to identify conunon objects.) 
Number Concepts segments asked students to play a number game, count 
aloud, count sounds, write numbers from dictation, and give successors. 
Segments from the Applications strand covered measuring with a ruler, ' 
days of the week, and money ,^ while Geometry segrtjents centered around 
comparing lengths of lines. Addition segments contained oral arithmetic 
exercises. The content of all segments is indicated in Table I, 
Appendix A. 

Response Mode . In each lesson approximately half the segments 
required written responses, e^e^t for the first lesson, which had only 
one such segment. Other segments^ required oral or physical responses. 
Oral responses included constructed responses to arithmetic exercises 
(What is 2 plus 3? What number comes aft'er 17?) , responses to 
mathematical questions phrased as choices (W^ii^h is longer, a broom or 
a pencil? Which is worth more, a 5 cent coin oi^ a 10 cent coin?), 
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Table it 

Number of Pil'ot-lesson Segments by Strand and Lesson 



Strand 



Lesson 
J| 5 



6 Total 



Number 
concepts 



Applications 1 



5- ■ 3 



21 

in • 



Geometry 

Basic 
concepts 



0 ■ 1 



1 1 



2 



Addltiqn 



Total 



8 8 8 8 



18 



ERIC 



37 

58 



responses to general-interest or organizational questions (Children, 

y 

ariB you ready?), and recitation (rote counting, naming days of the week) 
Written responses were made on worksheets.^ Some were constructed 
(Write the answer: how much is 5 + 2?), some were multiple choice 
(Circle the empty glass), and some were drawn (Draw a line longer than 
the one shown on the worksheet). 

Physical responses were mostly in the "mando mando" game-- 
"roando" means '"I command" ia Spanish— in which childeren followed 
the instructions of a leader (Clap your hands, ^raise two fingers). 
In addition to worksheets^ and pencils, the only jpaterials used were 
cardboard rulers.* 

Almost all segments requiring written responses contained 
five 'exercises (some of thos^ presented after the taped lesson 
had 6 01* 8 exercises). 

Results . In general, the children responded actively and 
with apparent enjoyment. They gave oral responses readi|.y, even 
answering rhetorical questions (which we now try to avol^). At first 
the teachers were quite active.<in elicting ora^ responses, but this 
seemed unnecessary and we now discourage the practice.. 

Because we anticipated that children would have difficulty in 

following oral instructions, we made frequent use of repetition. We 

found that this of*ten confused and rarely helped the children. They 

followed instructions well, experiencing difficulty only when the ' 
/ 

instructions were ambiguous or the content too difficult. However, 

« 

38 89 



It . « 

ocqasionally an unexpected noise drowned out an essential word. This 
caused problems only When children were working individually on 
worksheets, and we now repea't only key words or phrases that provide 
instruction i*or written work. In one- lesson we used a "cartoon" voice 
to give, exercises. Only a small proportion of the students understood 
the voice and we have dropped that practice. 

The children's high level of listening skills when instructions 
were presented contrasted strongly with their response to stories in the 
pilot lessons. For the most part they appeared bored and uninterested 
in the characters. When questioned after the lessoni, students indicated 
that they did not follow plots. We have decreased both the amount an^ 
the complexity of story material used in lessons. 

/ The children had more difficulty using the worksheets than we 
had anti,cipated« They often marked answers in the wrong spaces and we 
have redesigned the worksheet to add an identifier for each section. 
Before presenting an exercise we ask the children to put a finger on 
the identifier that marks the space for the answer. 

We ^perimented with the amount of time allowed for various 

types of responses, and developed the following set of guidelines: 

oral response to a question with 2 sec. 
an obvious answer 

counting 1 to 5 Ipottle tops^ 5 sec. 

circling one choice among 2 or 3 5 sec. ^ 
/ pictures 

writing a i-digit number 8 sec. 

drawing 1 to 3 cirdles ^ 12 sec. 
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In several segments we tried to supply reinforcement by 
announcing the correct answer a|ter the children were giyen time to 
write a response. This procedure seemed to confuse many children and 
not to help the others. We have not found a successful substitute 
and do not presently give reinforcement for written answers. (We asked 
the children to cross out ratheV than erase an answer they wanted to 
change. They much preferred to/ erase , with a wet finger if no eraser 
•-li^s available.), * . ^ * - 

, Teachers seemed to be receptive to the program. "Some teachers 

who thought the cliildren would have diffi^lty listening to •and obeying, 
instructions from a recording machine' repeated many of the questions, 
thereby shortening the time allowed for the children to respond. We 

- - * 

now urge tefachers not to repeat* unless there-^is a, noise or distraction 
that prevents children from hearing the tape.^ 

For the first version of the firaft two lessons we wrote lengthy 
and detailed tetchers' guides, but.. these proved to he confusing; a much 
briefer guide formait was t^d for* tne six lessons,/ and is still in use. 
V. We iur^ now to an examination of student response ^ata, which 

are reported for all segments requiring written responses. During the 
lessons we made no attempt to inhibit cooperative answering or "copying" 
w'lich iertainly occur|. (We once observed a child marking two worksheets 
while her friend searched for a pencil.) Cooperatij^e answeV^ing inflates 
scores (at least for e^y exercie^s) but there remains, considerable j 
variation in scores. 



The number of students taking each lesson ranged from 155 to 
186. The ^^fflf^Si^ percentage correct for segments requiring written 
responses is shown in Table 5. (The identifier is for lesson 1, 

segment H)^ On the basis of previous experience we consider a 
performance level of between 80 and 90 percent correct to be optimal 
for first-grade children (lower levels are too discouraging). The 
performance level for the pilot lessons was acceptably high, falling 
below 70% correct for only two segments (L2-7 and L5-9). 

Evidence for learning appears when we examine scores for 
three 'segments presenting the same task, which had not been previously 
taught. Exercises in segments L2~8, L3-8, and asked students to 

measure pictures of objects (which varied in length from |3 to 10 

/' 

centimeters). As seen in Table 5, the percentage correct increased 
rvom 71.0 to 88 .'S. 

Although the overall performance level was quite high, there 
was substantial variation for lessons and classes. Mean percentage 
correct for each lesson for the six classes are presented in Table 6. 

Class 4 performed well consistently, while Class/2 performed poorly 

/ 

for the entire set of lessons. Other classes showed occasional high 

/ 

or low scores. This variability is not unexpected, but presents 
difficulties when trjring to adopt the appropriate difficulty level 
for lessons and exercises. 

Preparation of the pilot lessons gave the staff an opportunity 
to work out many of the procedures that would be necessary for producir 
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Table 5 



Performance on Pilot Lesson Segments 



Lesson & Strand n Mean Percentage S.D. 

Segment Correcjb 







NUM 


169 


Bo.B 


3.2 


L2-1 




BAS 


174 


78.0 ^ 


' 25.3 


L2-5 




MUM 


174' 


80.1 ■/ 


' 3.2 


L2-7 


a 


BAS 


174 


60.9 


It C 


L2-8 


P 


APL 


174 


71.0 


It c 


L3-4 




BAS 


100 


•71 C 

71 0 


in n 


L3-<5 




NUM 


186 


73.-2- 


,3.? 


L3-7 




GEO 


186 


88.0 


8.4 


L3-8 


P 


APL 


186 


78.3 


5.5 


LJ*-2 




. GEO 


173 


94.5 


4.5 






NUM 


173 


70.1 


8.4 


LI4-5 




BAS 


173 


83.9 


4.5 


L4-6 




GEO 


173 


83.7 


.0 


LH-T 


-P 


APL 


173 


88.3 


5.5 


L5-1 




APL 


155 


85.5 


5.5 


L5.-7 




ADD 


155 


78.8 


8.4 


L5-8 


P 


APL 


155 


80.6 


7.7 


L5-9 


P 


APL 


.155 


49.1 


4.5 


L6-3 




ADD 


174 


83.8 


3.2 


L6-J1 




APL 


174 


76.9 


16.4 


L6-6 




APL 


174 


83.5 


7,7 


L6-7 


P 


APL 


174 


91.4 


.0 



a , 

P means presented after the taped lesson (postbroadca^t) . 
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Class . 

1 
2 

3 
4 
5 
6 

Mean 



Table 6 

Mean Performance on Pilot Lessons by Class 

Percentage Correct 
Lesson 



1 


2 


3 


4 


5 


6 


Mean 


89.2 


* 

80.0 


73.2 


92.7 


60.9 


88.7 


80.8 


78.0 


68.8 


61.4 


65.1 


58.0 


62.3 


65.6 


83.3 


80.7 


89.9 


91.3 


81.1 


88.4 


85.8 


100.0 


85.2 


90.7 


92.0 


85.2 


94.6 


91.3 


92.0 


54.4 


79.8 


89.8 


70.3 


86.0 


78.7. 


87.6 


73.9 


74.8 


79.1 


75.0 


79.3 


78.3 


88. U 


73.8 


78.3 


85.0 


71.8 


85.6 


\80.1 
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lessons on a tight schedule. The results lead us to the following 
general conclusions about the design and use of radio lessons. 

1. Children are most attentive to radio lessons 
when they are responding actively. 

2. Mathematical activities are more engaging than 

the stories in our programs for first-gra^ children. 

3. Rhetorical questions are answered by the children; 
such questions should be used only sparingly and 
time must be allowed for responses. 

4.. Children listen to instructions and, in most cases, 
repetition is not needed. 

5. Children can learn hew topics from the radio lessons. 

Curriculum Structure 

Project lessons are based on the mathematics curriculum 
specified by the Nicaraguan Ministry of Education., A thorough revision 
of the primary mathematics curriculum was completed 1973f under the 
direction of Mrs. Vitalia. Vrooman, who is now N;Lcaraguan Director of 
, the project. An abbreviated. version of the new curriculum outline 
for First Grade appears in Figure 2. The list of topics is that of a 
typical 'modern mathematics' program. Except for the inclusion of 
formal work on multiplication and division, the outline closely 
resembles those prepared in the United States. It is also very similar 
to outlines we have examined from other developing countries, an 
illustration of ^he great commonality in primary school mathematics 
curriculums throughout the world. 

i 




A 

! 

\ 

First Unit: Basic Concepts (2 weeks) 

size, height, position, width, quantity; weight 

Second Unit: Sets weeks) 

set, element, comparing sets^ equality, inequality 



Third Unit: Systems of Counting (8 weeks) 
counting up to 99, ordinals, place value' 

Fourth Unit: Addition and Subtraction (4 weeks) 

addition and subtraction as inverse operations, sums, 
differences' to 18, addition and subtraction of 2-digit 
numbers without carrying or borrowing 

Fifth Unit: Multiplication and Division (3 weeks) 

Readiness work, multiplication combinations up to 27 i 
division with dividends up to 15, divisors of 2 to 5 



Sixth Unit; Common Fractions (2 weeks) 
halves, thirds, and fourths 



Seventh Unit: Money (2 weeks) ^ 

monetary unit — el cordoba, 5, 10, 25, 50 centavo 
coins, equivalencies 

Eighth Unit: Measures (5 weeks) 

length, volume, time, weight, pairs and dozens 



Ninth Unit: Geometry 

point, line, plane, curved and straight lines, 
angles, figures with 3, 4, more sides 

Figure 2* Nicaraguan first grade curriculum: condensed 
version of outline prepared by the Ministry of Public Education* 
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There are several reasons for adopting the Nicaraguan curriculum' 
as the basis Vor project lessons. First, the curriculum is certainly 
satisfactory as a basis for the radio lessons. Second, the Ministry 
has expended much effort in the last several years revising 'che curriculum 
and retraining teachers. We feel that teachers will be less resistant 
to a change in mode of presentation of lessons if the curriculum is not 
changed (once again) at the same time. Finally, the use of the same 
curriculum in experimental and control classes facilitates evaluation 
of the radio lessons. 

Some changes in emphasis and some reorganization of the Nicaraguan 
curriculum have proved necessary in structuring the radio lessons. As 
shown in Figure CI, each topic in the Nicaraguan curriculum is allotted 
a specific period for instruction. Teachers customarily follow these 
guidelines, presenting all instruction on a topic in a single block of 
time. Because of the demonstrated superiority of distributed practice 
we chose not to follow this procedure, instead dispersing instruction 
on each topic throughout the school year. 

The radio curriculum , which serves as the basis for radio lessons, 
is divided into topics or strands . For first grade the strands are 
Basic Concepts, Number Concepts, Addition, Subtraction, Applications, 
Geometry, and Measurement. For each strand a set of behavioral 
objectives was formulated, defining the behavior expected of a student 
who has successfully completed the first-grade instructional program. 
The behavioral objectives defined for the first-grade radio curriculum 
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are shown in Appendix D. For illustrative purposes we present several 

of the objectives for the Number Concepts strand in Table ?• 

The objectives specify only what the student should be able to 

do at the end of the year, and each objective must be subdivided in 

order to serve as a guide for instruction. The resulting instructional 

classes span the entire curriculum, but they are not disjoint. Thus, 

the first several instructional classes obtaihed by suWIvTdihg 

behavioral objective NUM-1 (see Table 7) are 

NUM-1-1 Count aloud from 1 to 5 

NUM-1-2 Count aloud from 1 to 10 

NUM-1-3 Count aloud from 1 to 13 

Count aloud from 1 to 20,' 

Class NUM-1-2 includes class NUM-1-1, which in turn is included in 

-NUM-1-3, and so on. 

Sometimes instructional classes are defined that do not appear 

in the list of terminal objectives, but are used to build requisite 

skills. For example, the first three instructional classes for 

objective NUM-8 (writing numerals) are 

NUM-8-1 Copy numerals from 1 to 3 

NUM-8-2 Copy numerals from 1 to 5 

NUM-8-3 Write numerals, 1 to 3 from- dictation. 

Copying numerals appears as an intermediate but not as a terminal 

task. 

In. addition to defining the instructional classes for each 
behavioral objective, the curriculum specialist must decide how often 
each class is to be sampled and how t6 relate the developmeht of 
objectives to each other. For example, the instructional classes that 
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Table 7 

« 

Selected Behavioral Objectives for Number Concepts 



NUM-1 Rote counting by ones 

When asked to count aloud, the child will count, "one, two, 
three,..." until stopped (no farther than 100). 



NUM-4 Rote counting by tens 

When asked to count aloud by tens, the child will count; 
"ten, twenty, thirty,..." until stopped (no farther than 100). 

NUM-6 Reading numerals 

Given a printed numeral (0 to 100) the child will say aloud 
" the name of the number . < 

Example: "What number is this?" 

l|8 * . - 



NUM-T Selection of numeral 

Given a set of 2 to 10 printed numerals (0 to 100) and the 
oral instruction to select a specified nuTieral the child will 
indicate the correct numeral by pointing or circling. 

Example: "Circle the ^1" 

58 0 ^ 41 "40 14 

NUM-8 Writing numerals 

Given an oral instruction 'to write a specified numeral 
(0 to 99) the child will do so. 

Example: "Write the number 87." 
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teach writing numerals from 1 to 3 must be presented before the student^ 
is asked to write 3 in response to another type of exercise. 

In the case of first-grade mathematics, we have good criteria 
for determining an appropriate ordering of classes. The subject matter 
itself is hierarchical; in many cases concepts and exercise types build 
logically 9n ^ne another. Moreover, at the Institute at Stanford we 
have developed several elementary-level mathematics courses, two of , 
them using computer-assisted instruction. He have collected over the 
years a large body of performance data, which provides additional 
guidelines for the ordering of instructional classes based on the 
relative difficulty of exercise types. These. results are reported in 
Suppes (1972, 197^), Suppes and Morningstar (1970), and Suppes, Searle, 
and Lorton (in press). 

The instructional classes are used to define lesson segments, 
£^s described below. For a lesson segment we must also specify the 

Q 

mode of presentation and the student response mode. An exercise may 
be embedded within a story or a realistic situation familiar to the 
children, or it may be presented abstractly, without embellishment. 
Students may be asked to answer orally or in writing. 

The strands. and instructional classes specify the content 
of the curriculum, but not the relative emphasis given to each 
topic. Decisions about allocation of time were made using the 
Nicaraguan curriculum guidelines and the results of investigations ^ 
^bf relative importance of topics in mathematics tfexts written in 



the United States (Suppes, Searle, and Lorton,.in press). The 
proportion of time devoted to each topic for five, lesson blocks is 
shown in Table 8 for the first half of first grade. For the first 
lessons, exercises from the Basic Concepts and Number Concepts 
strands are used, in roughly the ratio 1:4. As new topics are added 
the time spent on Number Concepts exercises decreases, reaching 55 
percent by Lesson 85. The percentages shown In Table 8 are derived 
from ,the number of segments frbm each strand that was used in each 
lesson. 

/ 

Lesson Production 

, We turn now to the process of translating curriculum 
specifications into scripts for radio lessons, preparing auxiliary 
lesson materials, reproducing materials and distributing them to 
schools. The entire process requires close cooperation between the 
curriculum specialist, the writers of scripts and teachers' guides, 
and the artist to ensure that the final lesson accurately reflects 
the intent of the curriculum specialist. For purposes of discussion 
we separate the process into four steps. 

1. The curriculum specialist designs an individual lesson. 

2. The script writer translates the specifications for 
the lesson into a radio script. 

3. To produce the lesson, 

a. the artist prepares the worksheet, 
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■Table 8 

Percentage of Instruction Devoted to Each Strand 
in 5-Lesson Blocks 



Lesson Strand Identifier 

range 



I- 5 
6-10 

II- 15 
16-20 
21-25 
26-30 
31-35 
36-40 
41-1^5 
46-5o\ 

\ 
\ 

51-55 \ 
56-60 \ 
61-65 
66-70 
71-75 
76-80 
81-85 



\ 



BAS 


<JUM 


ADD 


APL 


SUB 


31 


69 








20 


80 








12 


74 


2 


12- 






88 


10 


2 




5 


67 


20 


8 






67 


27 


6 




3 


60 


37 


10 




3 


60 


21 


16 






65 


19 


. 16 






63 


27 


° 6 


4 




51 


26 


17 


6 




60 


18. 


18 


4 


\ 


73 


9 


3 


15 
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33 




18 


\ 


64- 


16 


7 


13 




, 54 


6 


14 


26 




55 


14 


5 


26 



51 

52 
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b. a teacher training expert prepares the teacher's 

guide, and " • i 

f. 

c. the recording artists record the lesson, under the 
direction of the radio specialist. 

The components of the lesson (worksheets, teacher^'s guicles) 

are reproduced and distributed to schools. * 
I 

Step 1: Design of an individual lesson 

A radio lesson is specified by selecting an appropriate group 
of instructional classes from several strands. Each instructional 
class provides the instructional content of a lesson segment , and the 
segmertt description specifies the exercises, the mode of presentation, 
and'* the mode of response required. Each lesson is comprised of from six 
to ten segments, presented by radio and by the. teacher in the post- 
broadcast period. For example. Lesson 18 (near the beginnirjg of first 
grade) has seven radio segments and three postbroadcast segments. 
The segment descriptions, as they appear ^in the outline for script 
writers, are shown in Table 9. (The original outline and the other 
materials associated with Lesson 18 are presented in Appendix E.) 

Table 9 illustrates the variety of topics and response modes 
that may be incorporated in a single lesson. However, as is. evident 
from the outline, topics are not chosen at random, but in relation to , 
one another. Segments 1 and 7 give different types of practJjce with 
roughly the same addition combinations. Segment 4 provides practice 
in writing the numerals needed in Segment 5, arid so on. An. outline 
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Table 9 



Segment Descriptions for Lesson 18, Grade One 



Segmen t Pr esen ted 
number by 

t Radio 



Description 



2 
3 

4 

5 



9^ 



10 



Radio 
Radio 

Radio 

Radio 

Radio 



Radl'o^ 



T:)acher 



Teacher 



Teacher 



Show the addition facts- 2-f2, ^♦i2, 4+1, U2 
using fingers. "How much is^ plus 2?" 

Rote count from 1 .to 20, two times. 

Give successors pr^^lly .f or 5, 8, 7'> 9* 10. 
"What number comes after 5?" 



Write numerals from dictation, 
number 4 (3, 5, 2, 6)." 



"Write the 



Write the successors of 2, 1*, 4, 3* 1* 
"Write the number that .comes after 2." 

Ordinals 'first' and 'second^', oral, then 
written response , ^using drawings. "There is 
a plate on the first table;^. What is on the 
second table? Circle the first table (second 
basket, second box, first dish)". 

Readiness for addition, drawing. "Draw 2 
balls on the first line. Draw 1 ball on the . 
second line. How many are there in all?" 
(oral response)* (U2, U3, 3-»-2, 2+2) 

Reading numerals from V^to 7 (printed on 
worksheet). '^"Circle the 3 (6,2,4,7,5)." 

Read numerals 1 to 9 on cards (prepared by 
teacher) . 

«• 

Count objects, from 1 to 10 (materials 
chosen by teacher). 



a 

Translated from Spanish. 



\ * 

like that shown in Table 9 (wi^th additional information concerning 
response modes, timing, and^ worksheet layout) provides the basis from 
which script writers produce a script for the radio lesson, cu^ridulum - 
writers produce th^ teachers' guide, and the artist prepares the 
worksheet. 

\ ■ ^ 

Step 2: Translation of lesson specifications into a radio script 

Before the lesson outline reaches its final fO|rm, the^ script 
writer reviews it and makes a preliminary plan for thd script. This- 
process often suggests revisions, which the curriculum specialist 
and the script writer make together. Then the script' writer prepares 
an outline for the projected script and reviews this with the curriculum 
specialist. No dialogue is written until the two specialists have come 
io full, agreement about the outline. ^ ^ 

Although the lesson is initially structured by segments, these 
are not delineated in, the lesson script and the writer is encouraged 
to embed ihe mathematics^in story contexts in those lessons where 
stories are used. Tha'^placement of songs and games, unless these are 
included in the outline, is also at ^the discretion of the script writer. 

• - • / c 

The translation of a^ segment de script ion^^4ii^ radio script is 
illustrated in the following excerpt (translated from Spanish) from 
Lesspn 18, which is based on the description for Segment 1 (see Table 
9). .The Spanish version of the script can be found in Appendix E. 
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The setting is a carnival, with Ijappy background musiq. 
The radio characters— Lulu, Carlos, and Lobo — aj'e 
laughing and talking excitedly, abput ^how many things 
there are to see .and buy* Lobo (a character who often 
makes mistakes) asks the classroom children to help him 
count all the things he bought. 1 - \ 

Lobo: First I got 2 balloons, then 3 mo^e...^ think 2 
plus 3 equals 5.. I 

* 

Carlos: Halt. Let's aee if he's right. Attention, 

children. Hold up two fingers on onei^ . hand. . .and 
hold up three fingers on thfe other hand. How 
many fingers are there? (pause) That's it — 2 
plus 3 is 5. 

And what ,el;ae did you get, Lobo? 

Lobo: I got 2 caramels, and then 2' more. 

Carlos: Children, tell mer-how much is 2 plus 2? (pause) 
That's it— 4. Bjut>,|aet's prove it. Hold up 2 
fingers on one hand, and on the other hand hold 
up 2 more. Now tell me, how many fingers are 
there? (pause) Very good — 2 plus 2 is 4. 

Lobo: I also got Roman candles. First I got 3 Roman 
candles, and then 2 more. 

Carlos: Okay, chil<tren--how much is 3 plus 2? (pause) 
Now let's prove it witfi our fingjgrs. Hold up 
3 fingers -on one hand , and hold up 2 on the 
other. How many fingers are there? That's 
\ right— 3 plus 2 is 5. 

\ ■ : ^ - - 

\ (Carlos does the same thing with 4 +1 (balls) and 

1+2 (flags).) 

Lobo: Three flags — one for you. Lulu, one for you,. Carlos 
. * and one for me! Oh, how many things I have now! 

In asking the children to 'prove' the correctness of their 
answers, the instructional program is teaching them a method for 
finding a . sum of two numbers that does not depend -on memorization. 
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When the first draft of a script is completed, the writer reads, 
it to a group of ^taff members including those involved with curriculum, 
teacher training and classroom observation. The listeners use their 
knowledge of children to comment on the clarity of instructions, the 
level of difficulty of :the language used, and the interest likely to 

to be generated by the/ stories and characters. The script is then 

/ ' ' ' 

/ 

rewritten (if necessary) in response to the criticisms of the staff. 

The penultimate version of the script is timed and any necessary 
adjustments are made. It is then ready for recording. We have found 
-in-Nicaragua that at experienced script writer', following the process 
we have described, can write two or three 20-minute scripts a week. i 

Step 3: Lesson production . • 

while preparing the lesson outline, the curriculum specialist 
makes a sketch of the student worksheet that will accompany the lesson. 
The artist makes a preliminary drawing which is checked for accuracy 
and clarity, arid then is redrawn in final form. Most workSheeEs use 
both sides of the paper and'> especially for early first gradie, contain 
many illustrations. , We employ an artist full time to produce five 
worksheets a V^^^* ^/ The worksheet for Lesson 18 is reproduced ^^^n. 
Appendix E. \ I ' 

A list^\or suggestions about the contents of the teachers' guide 
is prepared together with the lesson outline. A curriculum writer 



uses these to pr^uce a 2-3 page guide for each lesson, describing the 
instructional content and the teacher's role in the postbroadcast 



activities. (Appendix E contains the teacher's guide for Lesson 18.) 

Suggeaiions for optional activities are also included. We find that 

i 

one writer can write five guides each week, with some time left for 
visiting classropras. 

The final step in lesson production takes place in the recording 
studio. We use professional recording artists— three people play all 
•the parts. , We use prerecorded sound effects and songs and produce an 
entire tape in real time, l-^at is, unless some flaw in the tape is 
found, it is not edited aftep^he recording session. All music and 
sound effects are taped at\the same time as the spoken parts and the 
timing of pauses for student responses is precisely controlled. We 
find that an experienced staff--the artists, the producer, and the 
'radio techniciah-*-takes about' an hour to produce a 20-minute tape. 

Step H: Reproduction of? materials and distribution to schools 

We usef.an el^tronic scanner to.^ake a stencil of the worksheet- 
prepared by thie artist , and all materialise mimeographed at the 
■project office. During the pilot-testing ph^e materials are delivered 



to classrooms weekly. 



\ This completes the description of the proces^vOf lesson 



\ 

construction, but a few remarks remain to be made. We cdnsider it 
crucial that every person involved in lesson prqduction observe^the 
use^ of the lessons in the classroom. Thus we require all writers 
(of curriculum, scripts, or guides) to visit classes regularly, and 
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encourage visits by other staff members (artists, research staff, even 
secretaries) as, well. 

We want to emphasize also^^that close cooperation and mutual 
understanding between the curriculum specialist and the script writer 
is essential for the production of good instructional radio programs. 
The training of each of these professionals does not predispose them 
to working well together. The curriculum specialist talks about 
precisely specifying goals and objectives, while the script writer 
values intuition and literary creativity. To forge a working 
relationship between these two takes much skill, understanding, and 
good will. 

Guidelines for Script Writing * " 

As we gain experienice with writing and producing lessons, the 
project is developing guidelines that, incorporate the results, of our 
experience. A few of these will be mentioned here. ^ 

When children recite — numbers, days pf the week, and so on — it 

! 

is necessary to establish-a-rhythm for them. It is also important to 
tell them clearly where to start. We have taught the children to wait 
for the radio to tell them to start and we establish the rhythm with 
drum beats or beating sticks. 

Children often tr^y to anticipate what the radio is going to say, 
and start to respond before an instruction is complete. For example, 
in one lesson we intended to tell the children to hit the table using 
their elbows. The phrase "using your elbows" came at the end of the 
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instruction and before the children heard it they were using their hands. 
Rephrasing^^the instruction, "Use your elbows to hit the table three 
• times" avoids the difficulty. 

We exercise care in the use of sound effects and musi<3|. He try 
to use music that is familiar to the children, and open and close each 
program with the same theme music. No background sound is played during 
the presentation of instructions and exercises and silence is maintained 
vrtiile children are given time to- respond to exercises. 

When children are asked to start an activity they must be told 
when to stop. They do not automatically sit down after being asked to 
stand up, and if we fail to tell them to put down their pencils when 
they complet^e an exercise, they usually keep them in their hands and 
are often disEracted. We find it is important to indicate the end of 
an activity. If we don't the children seem to wait for something more 
to happen. 

' The vocabulary for instructions is carefully controlled and 

standardized. For example, we always use the word "tachar" (cross .out) 



rather than the phrase "hacer una cruz" (make a cross) . We always ask 
the children to "encerrar en un circulo" (enclose in a circle) when we 
want them to draw a circle around a figure. , The standard set of phrases 
was chosen after consultation with several curriculum experts and 
teachers,. We allow more complicated vocabulary^ and syntax for story 
components of the lesson than for instructions and exercises. 
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Tests Bnbedded in the Curriculum 

A ten-iteia test is included in every fifth lesson i and is - 
designed to obtain information about student performance on earlier 
parts of the curriculum. (This information is used during the 
process of curriculum development and evaluation.) The embedded tests 
are not described to teachers as tests, but as reviews. We chose not 
to tell the teachers the students were being tested to prevent any 
differential treatment of students during these segments. / 

The structure of the tests is presented in detail in Appendix F. 
Briefly, test items are exemplars of instructional classes that are 
sampled from strands In roughly the same propor^tion as the strands 
are represented in the curriculum (see Table 8). The population of 
classes sampled includes only those defining terminal objectives, not 
intermediate objectives. Thus, the instructional class described above, 
"copy numerals from 1 to 5" would not be included in the population of 
classes sampled for embedded tests. The population of classes is 
further restricted to those that have been administerd by radio and 
for which the task is independent of context (that is, does not depend 
on a preceding exercise). 

Diagnostic Segments 

In response to teachers who expressed an interest in evaluating 
student progress we are experimenting with the use of selected segments 
as diagnostic tests^ T^at is, we suggest to teachers that they can 
identify students who are having difficulty with a concept by examining 

• * 
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responses to the identified segment, "nius, we suggest they examine 
responses to Lez-B (Segment 6 in Lesson 62) to assess performance on 
the concept "greater or less than", L65-6 for successors, and so on. 
Suggestions for additional activities for students who need help are 
included in the teachers' guides accompanying these lessons* 



Chapter 5 
Structure of Radio Lessons 



We turn now to^a consideration of aspects of \the design of 
radio lessons, problems that have arisen, and an assessment of our 
experience to date. t 

\ 

Types of Student Response 

We distinguish at least three types of responses; that we ask 
of children. They may speak aloud, they may write, or they may respond 
physically. For each of these an observer can determine whether a 
child is responding. (There is a fourth type which we do, not use— • 
asking the children to think of a resppnse without communicating it.) 
We will discuss each of the three response types in turn. ; 

Characters in a radio program may talk either among^ themselves 
or directly to the listeners. We make a careful distinction between 
these two modes. When characters are talking to each other, we expect 
children to listen without responding. When a character talks directly 
to the children, we expect and plan for the children to respond. In 
this way a type of dialogue can be established between a radio^ character 
and the children. Student responses are highly structured, ahcl there 
is, of course, no complex interaction; nevertheless the process, engages 
the attention of the children. 

Oral responses include such 'conversations' between the children 
and radio characters, and also answers to exercises presented in bo 'oh 




I 

free-response format and multiple-choice format. Aa example of^an oral 

exercise in multiple-choice format is 

I am thinking of two objects — a box and a ball. 
'Which is round? 

An oral exercise in free-response format,, presented abstractly, is 

What is 5 plus 10? 

-^nd presented in story form, 

Juan earned 5 centavos yesterday and 10. centavos today. 
How much did he earn altogether;? 

Recitation — rote counting, reciting the days of the week or months of. 

the year— r is also used. As another type of oral response, children sing 

songs. A song is taught by having radio characters sing it several 

times at its first presentation and then at least once in several 

successive lessons. After only a few repetitions the children are able 

> 

to join the singing. Many of the songs we use are about mathematics. 
Lyrics are writteri by the project staff and set to i2usio and recorded 
by Nicaraguan musicians. 

Physical activity is a second kind of response that the radio 
characters ask of the children. Children may play games—one game has 
them patting their knees, their shoulders and their cheeks a specified 
number of times — or they may be asked to hold up fingers, handle 
materials, or point to pictures or numbers on the workshe'dt. 

Finally, the children are asked to write on the worksheet*. 
Once again, exercises are presented* either in multiple-choice or 
in free-response format. In the former, children mark the correct 
0^ 




choice, while in the latter .they may draw '^pictures or write numerals 
or words. 

We are experimenting to find an appropriate level of^activity 
for the children* Our; present lessons are much faster paced and ask 
for more responses than the initial lessons we pilot-tested. At 
present the lessons ask for an average of two to three responses per 
minute, and our classroom observations suggest that this rate of 
responding could be increased. The children appear inattentive while 
radio characters talk to each other, but as soon as a character adopts, 
the tone of voice used to talk to the children they become attentive. 

Maintaining children's attention is, of course, a necessary 
prerequisite for effective radio lessons. Our initial view was that 
we would use stories to engage the children, and embed mathematical 
work in a story context to maintain interest. Pilot tests of lessons 
designed in this way, using kindergarten and first-grade children in 
California and first-grade children in Nicaragua, have convinced us 

9 

that the mathematical activities are intrinsically interesting ta the 
children and do not need story support, as long as the children are 

r 

asked to respond frequently. Thus, our view of the role and importance 
of stories has changed markedly. < . 

At present we are experimenting with the use of lessons that 
have songs, games, and oral and written exercises, but no stories. 
These lessons are presented alternately with lessons containing story 
episodes. Both types of lessons use the same ma^in characters, but 

65 
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subordinate characters appear only in. the lessons containing stories. 
Our .current view is that stories are useful for presenting mathematical 
material in a realistic setting but, at least for young children in the 
classroom, are not needed for maintaining interest level. 

Providing Reinforcement ^ - 

We have experimented with various methods of reinforcement. 
In a pilot test of five recorded lessons, using California kindergarten 
and first-grade children, we ro\m& that f^w children changed their 
written answers, or even appeared to listen, when the radio lesson 
provided a correct answer several seconds after an exercise was presented 
We found first-grade children familiar with the procedure for checking 
a group of written answers, but this procedure gives no reinforcement 
with oral exercises, because the children do not' remember what the 
exercise was. 

To date, the most successful method we have found for providing 
knowledge of results is to ask the children to respond orally. In^ 
this way, children who do n ot know the correct answer le arn from those 
who do. This method can be used in conjunction with written exercises 
by first asking the children "to write their answers, then to say them 
aloud.* Because of its effectiveness in enhancing learning, we consider 
reinfo/cement an important aspect of* the lessons. We do not feel 
satisfied that we are providing enough reinforcement in the most 
effective manner, and we continue to experiment with this aspect of 
the radio lessons'. 
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Using Concrete Materials 

There is almost universal agreement today that lower primary- 
level students should usej concrete^ materials while studying mathematics 

However, there are many ojbstacles to the use of materials during radio 

1 i 
lessons. Although the best Nicaraguan teachers use materials, the ^ 

I ' 

practice is limited, and {therefore unfamiliar to many teachers. 

t 

Nicaraguan schools have no money available for the p^chase of material 
nor any central method fo| distributing even U^ose that might be 
obtained free. Thus, each teacher Is individually Responsible for 

■ ■ ' i 

tjieir provision. 

Problems of an entirely different sort arise when children 

! 

are asked to handle materials themselveaj. The objects are dropped, 

i 

i I 

misplaced, and argued over'. The fast pacing of the radio lessons does 

i 

not allow time for coping with such problems. Even more^ serious 
problems arise when the teacher has failed to distribute the materials, 
or has handed out the wrong number, and the children are unable to 
follow the directions given by the radio. 



Notwithstanding these difficulties, we are attemptirig to use 

_ * \ 

mater ials--for the most part, bottle caps— .during radio lesson^, with 

4 



considerable success. He ask the teachers to distribute a specifi^ed 
number of caps (to date we have used no more than 10) to each child 
before the lesson starts. The caps are used early in the lesson and 
then the radio asks the children to leave them alone. The children 
respond well ^ to this instruction. The primary use of these small 
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numbers of caps* is -to illustratje addition and subtraction. Counting 
larger sets is delayed until ,the postbroadcast period. We have found 
the bottle caps to be noisy and somewhat unwieldy and have plans to 
try other materials next year. 

The use of materials during the postbroadcast segment of the 
lesson has fewer disadvantages because the flexibility* of the classroom 
permits the teacher to cope with difficulties that arise. * We encourage 
teachers to provid'e coricrete experiences for students and will use the 
teachers' guide to suggest materials and activities. 

The Segmented Structure of Lessons 

The research literature on the effect of practice on learning 
supports the, proposition that skills need to be practiced regularly 
to be maintained, and that distributed practice is. superior to massed 
practice. Thus, a specified amount of practice is more valuable when 

4 

it occurs in short, frequent sessions than in longer, less frequent 
sessions. In a classic paper that summarized 48 unpublished studies, 
Wilson (1925) concluded 'that drill should have the following attributes 
in order to be effectives 

1. It should be on the entire process*. 

2. It should come frequently in. small amounts. 

3. Each unit should be a mixed drill. 
i|. It should have a time limit. 

5. Examples in a unit drill should be in order of difficulty. 

6. It should include verbal oroblems. 

7. It, should facilitate diai^nosis. 

With these experimental results in mind , we have developed a lesson 
structure that provides for several different topics in each lesson, 
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as we^l as different types of activities and different modes of 
Responding. Oftee a topic has been introduced, it reappears at regular 
intervals',' sometimes in the same, sometimes in different contexts, 
providing continuing practice for the childi^en. Weekly tests (included 
to provide information for curriculum development) are not identified 
to either students or teachers as such, but are presented as reviews. 
These sets of exercises provide a further opportunity for students to 
'^^j^ractice skills already learned* 

Differential Learning*'Rates 

Coping with differential learning raEes^ls. the most difficult 
problem facing the developer of curriculum for radio. During this, 
first exj>erimental y.ea^ we are concerned primarily with exploring the 
extent of th^ problem. How large is the spread in^ achievement at the 
beginning of the year, and as* ttie school year progresses? We will use 
results of tests embedded throughout the radio curriculum to examine 
this- question. Do children who are performing very well or very poorly 
appear ^to lose interest in lessons? We will rely on classroom / 



observers and teachers' reports to answer this question. 

We have given some thought to ways of providing different 
levels of instruction to different children during broadcasting. In 
our testing program we developed exercises that had different printed 
materials associated with a single set of » oral instructions, allowing 
childre^ir who were listening to sf common set of instructions, to work 
different exercises. We think this "Siethod holds promise for allowing 



69 



children to practice skills at different levels of difficulty. . 
Providing postbroadcast materials for children of different ability 
levels would also contribute to differentiating instruction. 

Allocation of Instruction Between Radio and the Classroom Teacher 

, . We are presently investigating the question of allocation of 
teaching responsibilities between the radio and the classroom teacher 
At the beginning of the school year we put a large number of exercise 
into the curriculum for the te^che^ to hancjle, teaching children how 
to use identifiers and how. to find their way around the Worksheet. 
We asked the teachers to use a strictly specified vocabulary so that 
^the chi-ldren would learn the same words and phrases that they would 
later hear in the radio- lessons. HoweVer, some teachers did not 
understand why they were asked to. use exactly the listed words and 
phrases and therefore did not follov^ directions while others substitfutei 
alternate expressions that seemed appropriate. . We think these exercise 
would have been more effectively taught by radio. On the other /hand, 
group aptivities involving a variety of materials are clearly handled 
best by the teacher. • « ^ 

We pan make some generalizations about who should teach what. 

\ 

The radio is better than the teacher for 

^ \ 
rote-counting and other types of recitatior , 

* fast-paced oral 'drill, 

songs,, 

teaching students to follow directions, 
teaching p^recise technical vocabulary. 
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The teacherj does better with activities that require 

I a variety of materials, 
i individual supervision (such as the 

introduction to the task of counting objects), 
group discussion* 

We are not jsure who does best with such topics as 

i , measurement, | ' ~ / 

! applications of arithmetic, / 
^ [ development of pr)oblem-solving abilities./ 



/ 



Summary 



He -continue to experime^nt with the format of the radio lessons. 

' * I ^ 'I 

He have^given particular attention to .the instructional aspects of the 

lesson. He have been quite successful in the presentation of 

instructjtorls — our first-grade/ students are able to follow directions 

so that throughout a lesson ihey use the appropriate/^ part of the 

worksheet. The instructional, portions of the lessons keep the 

attention of the children ancl most of the children /respond correct"*" 

to most of {the exercises. He\are concerned with the problem of 

maintaining^ interest throughout the year, and continue to investigate 

\ I 
ways of increk^ng the entertainment value of thei non-instructional 



portions of the lesson. 



i 



^Chapter 6 
1974 First-grade Achievement Test 

The 1974 testing program had two purposes, to measure student 
performance at the end of the school year on first-grade curriculum 
objectives, and to determine both the extent of performance differenpes 
between rural and urban students and the range of variation among 
classrooms. A multiple matrix-sampling design, in which each item is 
given to only a subset of students and each student takes only a subset 
of the items f was used. This design tests a large number of items, 
providing more information than a design requiring that each student 
answer each item; this advantage is partially offset by less stable 
estimates of student performance, leading to less^accurate comparisons 
between groups of students. 

A pilot test was developed and given to approximately 90 students 
In two classrooms. After modification the test was administered to all , 

students in 44 classrooms. The test was developed in the following 

« 

steps: 

1. The equivalence classes that defined the 
curriculum to be tested .were chosen.* 

2. The structure of the test and the number 
of items needed were determined. 

3. A procedure for sampling equivalence classes 
was chosen and implemented. 

4. The chosen equivalence classes were assigned 
to test forms-. 

5. ^ A test item was written to represent each 

equivalence class. 



The method outlined was followed quite closely" in the construction 
of the pilot iest. Exceptions will be noted as we describe the 
process. in detail. 

Definition of the Appropriate Curriculum 

. ' The universe of achievement test items is called the test 

curriculum . It is not ^Identical to the curriculum which ^orms the 

j 

basis for radio lessons (radio curriculum). In constructing the 
test curriculum, the appropriate topics are divided into strands, 
and then each strand is divided into equivalence classes , sets of 
items. that have structural features in common. Each equivalence 
class is defined explicitly in terms of such item characteristics 
as .the arithmetic operation, the exercise format (for presentation 
and for response), the size of the numbers, and so on. The 
equivalence class structure partitions. the entire curriculum into 
disjoint sets of exercise types. 

Two sources of information about the first-grade mathematics 
curriculum were used to choose the strands and the equivalence classes 
within each strand appropriate for a first-grade achievement test. 
These are the curriculum guide prepared by the Ministry of Education, 
described in Figure 2 (page 45), and our observ'ations of the topics 
teachers were presenting in the classroopi. 

The strands in the test curriculum are listed Xti Table 10. 
Number Concepts topics include counting to 100, reading and writing 
integers and. simple fractions, place value, size comparisons for both 
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Table 10 

Distribution of EqUiValehce Classes Among Strands 
in Curriculum and Test 

Number of Classes 



Strand 



Test 
curriculum 



Proposed 
pilot test 



Actual 
pilot- test 



Number Concepts 

Addition 

Subtraction 

Multiplication 

Division 

Geometry 

Applications 



218 
113 
71 
45 
11 
26 
70 



35 
19 
16 
10 
5 
5 
20 



21 
17 
16 
9 
5 
2 
10 



Total 



55U 



110 



80 



\ 
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integers and fractions, and the use of ordinal numbers up to 'tenth' , 
Because some teachers were teaching concepts more advanced than those 
specified by the Ministry curriculum guide, the Addition and Subtraction 
Strands were extended to include problems with 'carrys' and 'borrows' 
and addition and subtraction of fractions. As shown in Figure 2, 
multiplication and division are considered first-grade topics. 

Geometry includes 'readiness' topics such as the concepts of 
shape, similarity, position and length, and the Applications strand 
covers money, linear measure, pairs and dozens, time, and word problems* 
The test curriculum consisted of 554 equivalenc^p classes distributed 
among strands as shown in Table 10. 

Structure of- the Test * * 

The pilot test and the final test had the* same structure 
except for the number of items. The test had three parts, none of 
them overlapping. Part A was prepared in one form, and was given in 

all classrooms • Part B was prepared in five forms and all students in 

<> 

a classroom received the same B form. Part G vjas prepared in five 
forms, and these were assigned randomly to students within eacj) class, 
so that in each classroom roughly equal numbers of students worked on 
each C part. Each student received a single test booklet, which 
included the appropriate combinations of all three parts. 

^ Test items were of two types. For some items, part or all 
of the content of the exercise was presented orally. For others, only 
the instructions were presented orally — the exercise itself was 



printed. For the first type of item, all students in a classroom must 
receive the same item. Thus, such items could hot be included in Pai-t 
C of the test. For items of the second- type the test adaiinistrator 
could read instructions that apply to exercises .with different content. 
("Now work the next exercise" is the simplestJrrrStruction of this type,.-). 
These items could appear on all parts of the test. Because some items 
were unsuitable for use in Part C, it was pot possible to assign 
item? randomly to test parts. ^ 

In the pilot test, each form Qf each part contained 10 items. 
Thus, there were 10 Part A items, 50 Part B items, and 50 Part C items, 
for a total of 110. To otftain these items it was necessary to sample 
1 10^ equivalence classes from the test curriculum*; These classes were 
distributed among strands as shown in Table 10 in- the column labeled 
Proposed Pilot Test. The proportion of classes for each strand roughly 
corresponds to that of the test curriculum as a whole. 

M 

Results of the Pilot Test 

A trial run of the entire test as described here would have 
required 5 classrooms, one for each B form of the test. However, 
'^^because time did not permit such extensive testin?^ only two classrooms 
were tested. Thus, eight forms--Part A, two forms of part B and all 
five. forms of Part C~were tested. The 10 different test booklets used 
contained 80 items, distributed among strands as shown in Table 10 in 
the column labeled Actual Pilot Test. Each test booklet contained 30 
items, 10 from each part. The number of students who took each of the 
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eight forms and the resulting niean scores are shown in Table 11, Data 
*for individual items are presented in Table II of Appendix A. 

The distribution of item soores is shown in Table 12. Item 
scores ranged from 0 to 94. 5 percent correct, with a mean of 3^.6 
percent correct and a standard deviation of 26. U. The median score was 
27.8 percent correct. Table 13 shows the mean percentage correct and the 
range of scores for items from each strand. Results are shown separately 
for integers and fractions because error rates for these are markedly 
different. The scores suggest that few curricular goals are being 
met satisfactorily in these two classrooms. To give the reader a sense 
of the performance levels observed, Table 1U displays all of the items 
from equivalence classes from the Addition strand (using integers), 
with the .associated percentage correct. The item shown in quotation* 
marks was given orally. ^ . 

Administration of the pilot test revealed several short- 
comings in the testing procedures. There was much cooperative answering, 
especially where students sat at, tables or long ''desks* Some test 
questions were worded in such a way that students answered orally ^ 
instead of in writing. The pilot test proved to be very long- 
administration took about an hour. 

On the basis of the pilot testing experience," the guide for 
administer ijig the test was revised to include special instructions 
about rearranging seating patterns to decrease cooperative answering. 
The length of the test was shortened from 30 to 21 items by reducing 



Table 11 

Performance on Eight Subtests of Pilot Test 



a 

Part- Form n Mean Score 



A 1 91 5.8 

B 1 Ml l».4 

B 2 50 6.1 

CI 17 r 2.3 

C 2 18 2.0 

C 3 18 2.1 

C • 4 20 . 2.3 

C 5 18 2.6 



Maximum score = 10. 



( 
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Table 12 

Distribution of Item Scores for Pilot Test 



Percentage Correct Frequency 

0 - ,6 

1 -'5 3 
5.1 10 7 

10.1 - 15 6 

15.1-20 5 

20.1 - 25 11 

25.1 - 30 _ 5 

30.1 - 35. 2 

35.1 - 40 5 

4p;i - 45 1 

i»5.1 - 50 5 

50.1-55 3 

55.1 - 60- 3 

6t).1 - 65 3 

65.1-70 3 

70.1 - 75 1 

75.1-80 2 

80.1 - 85 1 

85.1 - 90 2 

90. 1 - 95 3 



Table 13 



Proportion Correct on Pilot Test by Strand 



Strand 

Numeration 
Integers 
Fractions 

Addition 

Integers 
Fractions 



Number of 
items 



21 
19 
2 

17 
13 
4 



Subtraction 16 

Integers 12 

Fractions k 

Multiplication 9 

Division 5 

Geometry 2 

Applications 10 



Mean percent 
correct 



53.6 

•? 

55.2 
37.6 

33.2 
42.6 
2.8 

21.3 
27.0 
Jl.2 

21.4 

10.8 

68.2 

36.0 



Range of 
percentages 



5.6 - 94.5 
5.6 - 94.5 
17.1 - 58.0 

0 - 70.0 
5.6 - 70.0 
0 - ,5.6 



0 - 52.7 
5.0 -32.7 
0 - ll.8 



5.6 - 38.9 

' / 

0 - 22.0 

44.4 - 92.0 

5.0 - 84.0 




Table 1U 

Pilot Test Items Orcfered by Difficulty 

Addition of Integers 

V 

Percentage Correct 
70.0 



3 -f 2 = ^ - ' 66.7 

♦ 

21 . • ' 5£l.2 



6 + 10 = » 55.5 



5 + 9 = _lK , , 5U.9. 
2 

0 50.0 



160 . . ' 

^•? 30 50.0 

/ 

"How much is 13 plus U?" U3.9 
20 + 7 = , 35.3 



.38 



I 



•f 4 ' 23.5 



I 



•f '55 j 22.2 



60 + 60 = ' , 16.7 

64 ' 
+ 8 "^.6 
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to 7 the number of items from each part* As shown in Table 15, the 

/' 

topics of addition and subtraction of frac^i^ons, .and division were^ j 
• entire^ eliminated from the test ^currixiulum. Small changes made in 

the distribution of items are shown in the table • The total number of 

I 

equivalence classes "l^ampled in the final test was 77* Test Items are 
shown in Appendix B. . 

Selection of the Classrodms to be Tested 

A list was;made of all first-grade classrooms, stratified by 
region (urban, municipal, rural). A classroom was bonsidered eligible 
for selection if there were 15 or. more first-grade children matriculated. 
From each stratum 10 classes were chosen at random. The classrooms were 
selected from each school without replacement in order to ensurje a wider 

distribution of schools (except for the municipal stratum, which had only 

i 

eight schools) . j 

r 

In addition to the 30 randomly chosen classes, 14 were jtested 

j 

for special reasons. Six classes had already taken some experimental 

radio lessons and we were interested in how these classes handled the 

I 

\ ' 

test. The 18 teachers who would use^^dio lessons in 1975 had already 
been chosen and we wanted data on how their students performed. Five 
of the 18 teachers taught classes that had been selected in the random 
assignment, and five more taught classes that had already used radio 
lessons (mentioned above) . The classes of the remaining eight teachers 
were also tested, bringing the total of non-randomly selected classes 
to 14 — these eight and the six radio classes. In all, 1241 students 
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Strand • 

Numeration 
Integers 
.Fractions 
Total 

Addition 
Integers 
Fractions 
f. Total 

Subtracltion 
Integers 
Fractions 



Table 15 ^ * 

Comparison of Content of Pilot and Final . 
Achievement Tests 

Number of Itfems 
Pilot Test * Finfal Test 



19 
2 
21 



13 
17 



12 

^ 

16- 



24 
5 
29 



'11. 

0. 

11 



12 
0 
12 



Multiplication 9 

Division 5 

Geometry 2 

Applications - 10 



4 
0 
5 

16 



TOTAL 



86 



7-7 



81» 



8i 



were tested. ; ♦ 

Each o*f 'the thirty teachers selected at random was notified 

^ ^ < ' ' ! 

in advance of the test by letter from tlie Inspector to the school 

dAreator» — -The- nemajliiing, 1^ teachers were told about^ the test by 

staff members, who were in contaot with them regarding other aspects 

of the project • All teachers were assured that the test would not be 

used to evaluate uhem' or individual /students but that the data would 

# 

be used» to guide ciurricuium development and^ evaluate the^project > 
activities. ^ * ^ 



Test Administration. 4 — w 

Tests were administei*ed by two ^taff members. Oh^e read the 
instructions, while the other taped the testing session and acted as 
a monitor* While the children were teing tested the teacher was asked 
to fill out a short Corm for each child giving background information 
including age, sex, and years in school. 

^ The test took 30'jnlnutes to administer (including a shorty 
break) . About ^5 minutes before and 1Q minutes after the testing 
period were spent on administrative matter^* Examiners reported 
many of the usual problems encountered when testing firstrgrade 
students — the tendency to answer a!loud, confusion about following 

directions, and so on. These problems seemed unusually Severe because 

1 ' ' ^ 

of -the novelty of the test situation for these students. Ttiey had 

never experienced any of the following: people from outside coming 

in to give them a, test, printed tests, the exercise presentation 



fonnats used 1:^ the test, handing out of pencils, mathematics exercises 
presented orally (requiring written response], a, tesp with a variety 
of mathematical operations presented, and thj tape r^^ording of 
xlassnoom activ-ities.- la many classrooms children see\ned bewildered 

'I V ' 

by the situation. Although children had difficulties with the test 
sitxiation, and we must certainly keep these jin mind when^ inispecting 
test results, it is important to note that for four of th^ 77 exercises 
the percentage correct was over 90. Thus, kt least for soflie exercises. 



almost all the children were able to respond correctly. 

The examiners noted that the six classes that had jqst 

completed taking the experimental radio lessons seemed to find the 

i 

test examination situation much less confusing. %he format for the 

1 • . \ 

test was quite similar to that used for worksheets during the^^ 
lessons, and the ex^aminers felt that the radio lessons had provided 



some training in those skills needed to respond successfully during 



Lr 



th& test, 



I 



Test Results I 

^ i 

Data for individual items are presented in Table III of: Appendix 
A. The mean number correct for each part of the test is shown in 

Table 16 (data are for 12^1^1 students from 44 classes). Scores ^or the 

I 

A and B forms of the test are higher than those for the C forms.* It 
is possible that the exercises in the C parts were harder. It is also 
possible that the reduction, in cooperative answering (because children 
had different foriss of the test) is responsible .for the somewhat loW^er 



ERIC 



86 f^} 

9 



Table 16 

Performance on Eleven Subtests of Final Test 



.a-. 

Part Form n Mean score Standard 

, deviation 



A 


1 


1241 


4.51 


1.98 


B 


. 1 


246 


4.07' 


1-53 


B 


2 


265 


' 4.60 


1.54 


B 


. 3 


223 


4,45 


1.50 


B 


4 


240 


3.95 


1.86 


B 


5 


267 


3-70 


1.93 


C 


« 

1 


248 


2.79 


2.15 


C 


2 


255 


2.37 


1.86 


G 


.3 


243 


1.92 


1.58 


C 


4 


246 


3.15 


2.14 


C 


5 


249 


2.09 


1.87 



Maximum score = 7. 



87 



scores. 

The structure of the test provided an opportunity to assess the 
extent of coopei*ative answering. Each test booklet was organized so 
that questions 1, 2, 6, 13, 1^, 17 and 18 were from part A, questions 
3, 7, 8, 11, 12, and 21 were from part B, and questions 5, 5, 10, 
15, 16, 19, and 20 were from part C. The examiner led the children 
through the first 15 questions on the test, so that all children worked 
on the same question at the same time. For example, for question 5 
(Part C), children were told "Read the numbers carefully. Write the 
numbers that are missing." The child had printed on his test booklet 
one of five exercises, depending on which C form he had. 

A child who copied an answer from his neighbor ran the risk of 
copying a correct (or incorrect) answer for an exercise different from 
the one printed in his test booklet. It seems reasonable to conclude 
that a child copied from a nearby paper when his response is correct 
for an exercise from a different form, the complexity of the questions 
supports this conclusion. For question 5 the number of childr^en 
who apparently copied is shown in Table 17. The numbers along the 
diagonal show the number of students who gave the correct answer to 
the exercise they were given. The numbers off the diagonal show the 
number who gave the correct answer for an exercise bn 'a different form. 
For question 5, 80 children, approximately 9 percent of the, number who 
responded incorrectly, gave the correct answer to an exercise from a 
different form. 




Table 17 
Extent of Cooperative Answering 

. ' a . - 

' , . on Question 5 

Form student Form for which students response 

took was the correct answer , 

^ 1 2\ 3 ^ E 

Number of students 

1 • . 101 1 .3 3 . ? 



17 



no 



122 



52 



Note. About 250 children took each test form. 

a ' 

Question 5: "Bead the numbers' carefully . Write the numbers 
that are missing." 

Form 1: 30 10 ' 50 . Form 1: 72 73 71 



Form 2: 2 1 6 Form 5: 8 7 6 

Form 3: 5 .1,0 15 
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Performance on test items summarized by strand is shown in 
Table 18. Percentage correct for the Cive geometry readiness items 
ranged from 73.0 to 98.9. (Two of these items are sh9wn in -Table 19.) 
The high scores for these items provide confirmation that students 
were ab^Le to understand directions and respond correctly when they 
knew the answer. 

The range of performance is shown for. all strands in Table 19* 
The performance level jwas quite low for addition and subtraction items; 
only slightly more than half the student? responded correctly to che 
easiest items. Approximately percent of' the students responded 
correctly to the easiest multipMcatibn exercise. • ' 

Items from the Applications strand included word problems , 
presented orally and in written form. The oral exerQises required a 
free-format response; the written exercises were in multiple-choice 
format. Word problems (customarily presented in written form) ar^ 
considered very difficult for young children. However, we have long 
suspected that children would find such problems easier if they were 
presented orally* (For some positive experimental results on the 
reasoning abilities of young children when problems are given orally see 
Suppes, 1965.) The results shown in Table 20 support this supposition. 
The percentage correct ranged from il9.6 to 71.3 for five word problems 
presented orally. (Note that 71.3 percent is higher than the performanc 
on any of the computation items— see Table 19.) On the other hand, 
performance on written word problems ranged from 5.^ to i<0.2 percent 
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Table 18 

Proportion Correct on Final Test by Strand 

Strand Number Mean percent Standard 

of items correct deviation 

Numeration ^29 / 57.0 22.4 

Integers' 24 56.6 . 23.1 

Fractions 5 ' 58.6 ^ . 20.8 

Addition 11 ^ ^ 45.4 15.0 

Subtraction 12 ' 32.4 13.9 

Multiplication 4 33-3. 9.2 

Geometry 5 89.4 ' 11.1 

Applications 16 40.2 21.2 
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Tabl,e 19 

^- o 

Items with Highest and Lowest Percent Correct on Final 
Achievement Test by Strand 



Strand 



Highest 



Percent 
correct 



Item 



Lowest 



Percent 
correct 



Item 



Numeration 



91.46 "Write the 
number 7." 



16.46 "Write the numbers 
that are missing." 

72 73 n 



\ddition 



67.71 "How-much is 
5 plus 1?" 



11.76 38 



Subtraction 



60.00 "How much is 
6 minus 3?" 



7.62 42 

5 



Multiplication 43.62 2X5= 



25.00 9 X 10 



Geometry 



98.87 "Circle the 

longest ladder." 
(3 choices) 



Applications 71.30 " 



73.03 



Manuel had 4 2.88 
buttons to play With. 
Playing With another 
boy he lost 3. 
Write the number of 
buttons he has left." 



"Circle the 
glass that is 
on the right." 

"Write the hour 
the clock says." 
(lOiSO) 
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Table- 20 
Performance on Word Problems 
Comparison between Oral and Written Problem Presentation 



Presentation 
\ and response 
\ mode 



Required . 
arithmetic 



Oral, free response 3+2 



Percent 
correct 



65.9 



Oral, free response 3 + 2 -f = 



Oral, free response i| - 3 = 



Oral, free response 



2 X 4 



Oral , free response 6/2 = 



70.2 
71.3 
49.6 
52.4 



Written, multiple 



Written, multiple 
choice 

Written, multiple 
choice 

Written, multiple 
choice 

Written, multiple 
choice v 



Oral 
Written 



5-3 



6 + 1 



5 + 

«1 + 2 = 
3 + 3 = 



Mean 
61.9 
29.7 



31.1 
36.1 
5.4 
40.24 
35.7 



Standard Deviation 
10.2 
14.0 
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correct. 3ince these exercises were presented with three answer 
choices, the expected percentage correct by chance is 33*3* 

Examination of Student Errors 

An examination of the types of errors made by students on the 
achievement test provides information that can contribute to designing 
the radio lessons. It is important to identify those aspects of the 
curriculum that children are not master^ing, and to take particular care' 
in teaching them by radio., We found that students had more difficulty 
with conceptual, as compared to computational, aspects of the curriculum 

Students often added the numbers presented in an exercise, 
instead of subtracting or multiplying as appropriate. The frequency 
of these errors is shown for nine subtraction exercises in Table 21 
and for four multiplication exercises in Table 22. For the exercise, 
5 - 3> 27 percent of the errors were of this type, and for the exercise 
5 X 1 (written vertically) the response, 6, was almost as frequent as 
the correct response, 6. These results suggest that many students have 
failed 'to master the conceptual task of identifying the correct 
operation. The prevalent practice in the classrooms of Masaya of 
limiting instruction to one arithmetic operation at a time probably 
contributes to the students' difficulty. 

Students seem to have less difficulty identifying the operation 
when exercises are presented orally. One exercise, 6 - 3> was presented 
both orally and in written form. The percentage correct for oral 
prese'ntation was 60, compared with 25 for the written form, and the use 

c 
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Table 21 

Frequency of Use of Wron^ Arithmet-f c Operation: 
Addition Instead of Subtraction 



Item 

Oral 
6 - 3 = 



Number oif Students Who 

Took item Subtracted 
correctly 



265 



159 



Added 
(correctly) 



28 - 2 = 



2J»0 



104 



Written 

5 - 3 = 

6 - 3 = 



1241 
239 



618 
■ 60 



169 
30 



13 - 8 = 



255 



72 



10 



72 - 1 = 

10 
- 7 



246 



249 



78 



54 



19 . 



30 



. 90 
- 10 



245 ' 



63 



27 



84 
- 21 



. 243 



87 



■ ^ 
29. 
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Table 22 ', 

i 

Frequency of Use of Wrong Arithmetic Operation: 
Addition Instead of Multiplication 



r - 

^ ^ 'Number of Students Who 



Item Took item Multiplied Added 

correctly (correctly) 

Written 

2X5=' 2H3 106 35 



5 

X 1 249 ■ 72 



/ 

9 X 10 = 248 62 23 



32 

X 3 267 70 . 25 



96 U') 



of the wrong operation was three times as frequent for the latter. The 
frequency of use of the wrong operation was also very low for word 
problems presented orally. For the subtraction exercise 4 - 3 in storey 

context, 159 of 223 responses were correct and only two students 

\ * 

answered 7. For the Multiplication exercise 2 X 4 in story context, 
119 of 240 responses were correct, and one student responded with 6. 

The most frequent error for operations with zero was to respond 
with the number zero. For the exercise, 3 + 0, of 246 children, 103 
answered 6, 34 answered 0. Similarly, for 6 - 0, 88 of 248 children 

\ . ' 

answered correctly, 43 responded with 0. 

^ When writing two-digit numerals, f.irst-grade children in the 

United States olTten reverse the digits. The same is true of our sample 

. f ' 
of Nicaraguan first-graders. When asked to write 15, 83 percent of the 

i 

children respor^ded corhectly; writing 51 for 15 sccounted for 10 of 

the 38 errors, j Similarll^, writing 35 for 53 accounted for' iTof 89 

f 

errors . 

f 

Students performed poorly on the task, "Write the number that 
comes before X.r For three exercises in which X was a two-digit^number , 
percentage corrfect ranged from 28 to 41. From t5 to 23 percent of the 
students gave the successor rather than the predecessor of the number. 

percent of t)i^ students correctly gave the successor , 



In contrast, 79 
to 29, and only 



1 percent incorrectly gave the predecessor. 



Comparison of S >udents, from Different Regions / 
An impoj^tant aspect of our testing program was to compare / 



performance of students from urb&n, municipal, and rural schools. For 
this purpose we obtained for each student an estimated score for the 
77 items of the entire test. The method used was adapted from that of 
Kleinke (1972) and a full description appears in Appendix C. In brief, 
the^ estimated score is obtained addirtg together the scores for a 
student on the parts of the test Vie took, the mean scores (for all r • 
students) on the parts of the test 'the he did not take, and an ; 



adjustmeiit[for the student based on the difference between his own 
scores arfd the mean scores on the parts of fhe test he took* The 
maximum' p<& sib le estimated score is 77, the total number of exercises 
tested. The' mean estimated score for ail (1241) students was 37.1; 
mean scores for classes ranged from 23-5 to Scores yor all 

classes are presented in Table IV, Appendix A. 

Neither the comparisons using estimated scores nor those using 
scores obtained on individual parts of the test showed e ^significant 
difference in performance between students from different regions. 
Means ariHwstandard deviations of estimated scores for different student 
groups^are shown in Table 23- The lack of a performance difference 
betwejgn .urljan and rural student^ is quite surprising. Of the possible 
explanations, we were able, to test one—the effect of age. The age 
distributicjn for urban, municipal, and rural students in the test 
population' was shown earlier in Table 3 (page 21). The mean afre for 
urban students is 8.2 years while that tor rura^ students is 8.5 years, 
not significantly different. An alternative hypot^hesis is that the 
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Table 23 

Summary Statistics Using Total Scores Estimated by 
Kleinke Procedure 



Student • n Mean Standard deviation 

group 

44 clagses 1241 37.10 12.76 

10 urban classes 301 37.24 12.47 

10 municipal classes 310 36.42. 13.00. 

10 rural classes 263 34.24 12.70 

total 30 classes 874 36.05 12.7-7 

6 radio classes > 157 40.13 12.34 



urban and rural environments of the Department of Masaya may not be 
sufficiently different to produce the differences typically found,' 

The groups of students who took the pilot radio lessons 
attained the highest mean test score (see Table 23). This may reflect 
their nbnrandom selection, or may in fact result from the test-taking 
practice afforded by the radio lessons. 

The results of the administration of the mathematics achievement 
test suggest the following general conclusions about first grade 
students in the Department of Masaya in Nicaragua. 

1. Most children, even though unfamiliar with the testing 
. situation » are able to respond to test exercises. 

2. Test results are contaminated by cooperative answering. 

3. Children perform^ well on- items that test general 
knowledge. 

4. Children perform poorly on most items that are 
characteristic of the formal mathematics curriculum. 

5. Children have more difficulty with conceptual than 
with computational aspects of the curriculum. 

6. Children perform better on arithmetic items presented 
as word problems 'than on those presented formally. 

7. There is little difference in performance between 
children from^ urban, municipal, and rural schools. 
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Chapter 7 
» An Early Assessment of Costs 

The^ purpose of this chapter is to provide an early assessment 
of what project costs have been and can be expected to be* Much firmer 
evidence is presently available for programming costs, of course, than 
for, implementation costs. The first section of this chapter summarizes 
the cost elements of the project — central project costs, program 

"production costs, transmission costs, and reception site costs — then 
presents a cost function for the project and average costs based on that 

* cost function* The next section discusses the results of the cost , 

analysis, with some of their implications* 

■ «• 

Cost Structure of the Project ' 

In this section we identify the cost components for the Radio 

Mathematics^ Project (RMP) and construct from them cost functions for 

the project. The costs fall into four categories — central project,^ 

program preparation, transmission, and reception site — and we first 

present information on those basic costs; as the project is in its early 

stages, some of these costs, particularly those dealing with reception, 

are estimated rather than observed. The project relies more heavily 

than do most on expatriate technical assistance, and for this reason 

programming costs in particular are relatively high* We thus also 



a 

This Chapter was , written by Dean T* Jamison of Eklucational Testing 
Service, a consultant to the project* 




briefly discus3 the cost implications of lower levels of expatriate 
technical assistance in the future. / 

V 

Cost Elements 

* Central pro ject costs , - We divide our central project costs 
dnto three major categories — start-up, administration, and research. 

The RMR commenced radio program production in Masaya, 
Nicaragua, in February, 1975; costs incurred prior to that time were 
for project planning, personnel moving and orientation, initial 
equipment purchase, and settling in. We thus treat those costs 
incurred prior to February, 1975j as being start-up costs that should 
be annua^i^ed oyer the lifetime of the project. Table shows ' 
start-up costs incurred at Stanford University and in Masaya. (Note: 
all costs are in 1975 U.S. dollars.) ^ 

The next aspect of central project costs is that dealing with 

. \ ' 

administration. For many of the staff involved, it is difficult to 
separate precisely central project a,jlmihistration effort from other 
functions; at Stanford the other function is principally research, 
in Masaya it is principally radio program production. The estimates 
of time allocation that we use are, then, simply the best estimates of 
.the project staff. Table 25 summarizes annual project administration 
cogts based on these best estimates; the total is close to $60,000 per 
year . 

The final category of central project costs is general research 
which is a major purpose of the project. The research costs listed 



Table 24 

Start-up Costs (through February, 1975) 



Start-UD cost project at Stanford ^ 

-Salaries $57,819 

i 

Staff benefits 9,830 / 

' Travel ' in'^Sk 7, 182^"^ 

Completer at Stanford 2^4,4^41 

Consulting 2,^400 

^ Equipment and supplies 3,832 

Indirect costs 49,587 

Subtotal $155,091 

Start-up cost of project in Nicaragua 

- b 

Salaries . 29,532 

Benefits 5,020 

Travel ' 8,395 

Moving, costs (household and 20,164 
car) 

c 

Allowances 24,305 

' Consulting 900 « 
■ d 

Expendable supplies 23,753 
e 

• F.Mipment 23,394 

Indirect costs 41,464' 

Subtotal 176,927 
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Table 24, continued 



up dost totals 

Total start-up cost $335,000 

Annualized start-up cost , 
(over 20 year project 
lifetime) ^ 

1. at 0 discount .rate l6,800/yr* 

2. at 7.5/1 discount rate 33,000/yr. 

3. at ^5% discount rate 54,000/yr. 



a 

The, egmputer was used for the production of reports, but 
for essentially nothing else during this period. 

b 

Salaries are for expatriate staff. 

c « ' _ c. 

Allowances include hcfusing allowance, post-differential 
allowance, and children's education allowance. 

d 

Expendable supplies breaks down as follows: 



office supplies 3^632 

books 770 

postage and freight '6,085 

minor equipment 4,124 
(tape recorders, etc.) 

Nicaragua expenses 9,139 

e 4 



The equipment includes four^ars, a mimeograph machine, 
an electronic iicanner for makJhg, stencils, and a 
calculator with statistical functions. 



III. Start- 
A- 

B. . 
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Table 25 

a 

Project Administration Costs ^ 



I. Annual costs of project administration at Stanford 

b 

(all figures given include direct and all indirect costs ) 



Project coordinator 50% of full time $14,600 

Principal investigator 6% of full time 3,100 

Secretary 50% of full time 7,000 

Administrative services ^5% of full time 

(covered by indirect costs) 0 

■ / ' ' ' ■ 

University functions — purchasing, shipping, 
accounting (covered by indirect costs)* 0 

Telephone, , off ice supplies, -etc., . - -il,i|00' 

Computer time 4,600 

Travel to Nicaragua for administrative 

purposes {25% of four trips) 1 ,400 

Subtotal ' $35,100 

II • Annual costs of project administration in Nicaragua 

Expatriate advisor 33% of full time $15,200 . 

Nicaraguan project director 50% of full time 5,000 
Secretary (bilingual) ^00% of full time 3.500 

Subtotal ^ $23,700 

III. Total annual costs of project administration _ $5jB,800 
a 

Costs incurred in cordobas are exchanged into U.S. dollars at 
the rate of 7 cordobas per dollar. ' 
bV • ^ 
indirect costs at Stanford University are 47Jt of base costs. 
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here do not include formative research for program development;, those 
costs' appear with other program development costs. Table 26 shows 
annual expenditures on research at the present time (1975); these costs 
may be expected to decline as the project becomes operational. ^. 

Program production costs. The RMP is currently producing 
programs at a rate of about 150 20-minute programs per year. The first 
.year of program production (CY 1975^ is being devoted to programs for 
Grade 1; the second year will be devoted to revision of Grade 1 programs 
and initial preparation of Grade. 2 programs. Thus, a single year's 
activity will involve both production of a set of about 150 pirograms, and 
the revision of an earlier set of 150; the output of a year's effort can 
thus be considered to be a produced and revised set of programs. 
Production here includes all steps required to plan, prepare, and put on 
tape the radio script 4s well as preparation of the student worksheet 
materials and the teachers' guide. 

" Table 27 summarizes the cost of preparing? 150 lessons; the 
total is $160|000. This yields a cost of $1,070 per 20-minute lesson 
or i3,200 per hour of produced material. This is far higher than 
previous costs of production of instructional radio in developing 
countries, which results from a number of factors. First, and 
relatively unimportant, this figure includes' cost of preparation of 
worksheets and teacher guides. Second, preparation -of ororrrams 
requiring frequent student response (^0 to 50 responses per 20-minute 
lesson) is probably intrinsically costly. Third, careful formative 
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Table 26 



a 

Research Costs 



It6m 

Principal Investigator 

(17JI of full time) ^ 

Project Manager 
(half-time) 

Statistician 
(half- time) 

Programmer 

Two graduate student assistants 
Consultants 

Telephone, office supplies 
Computer time 

Travel to Nicaragua (7 trips) 
Total 



Annual Amount 
$■ 9,200 

m,6oo 

7,200 

I8j600 
10,800. 

5,900 

•,800 
41,000 

9 , 600 

$118, 



All figures include indirect costs or U75f 
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Table 27 

Cost of Preparing 150 Radicf Lesson^ 

Item ' Annual Cost 

RecordJLng costs - $ 12/600 

*studio time, $l4/vies3on 
artists technicians, $il2/lesSon * 
director, $28/les9on 

Scriptwriting ^ 41,200 

2*full time equivalent Nicaraguans 

$M30/mo. each ^ ^ 

1 full time equivalent vw^jggtr'iate 
$3000/mo. 

Curriculum design 16,200 

1/2 full time equivalent Nicaraguan . 
$570/mo. 

1/3 full .time equivalent expatriate 

$3700/mo. ' ' ' 

1/2 full time equivalent secretary 
$260/mo. 

Artist for design and preparation of 3>500 
student worksheets 



1 full time equivalent 
$290/mo. 

Preparation of teachers' guides 3,000 

1/2 full time equivalent writer 
- $500/mo. 

Management ' 19,700 

1/2 full time equivalent Nicaraguan 
$580/mo. 

1/3 full time equivalent expatriate 

$3200/mo. 
1/2 full time equivalent secretary 

$260/mo. 

\ 
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'* Table 27, continued • 

« 

Item * . ^ Annual Coat 

'Formative evaluation $ 55,600 



1 full time equivalent Nicaragua 

r $430/mo. * , . ' 

1 full time equivalent expatriate 

- $3200/mo/ / 
data processing costs • ^ 

$1000/mo. 

Support and facilities * 8,200 

rent '$290/mo* 
utilities 90/mo. 

maid ^ 60/mo. ^ * 

guard 90/mo. 
transportation 150/mo. 
(exclusive of vehicle purchase) 



TOTAL COST " $160,000 
<rOTAL COST RER LESSON -1,070 
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evaluation is costly. Fourth, rtuch *6f the cost is fdr expatriate 

technical assistance, the presence of which more than* doubles the cost 

» • * 

of production over what lit would 'be if the same volume of production 
were achieved by Nicaraguan nationals. (If expatriates were replaced 
by nationals, the $160,000 annual cost of Table 27 would drop to 
$71,000; this would reduce the cost per lesson to $470.) % 

Assuming a 10-year lifetime for a completed and revised lesson, 
the annualized cost of having a lesson available (assuming a $1,070 
initial cost) is $107 if onq assumes a 0 discount rate, $l6p if one 
assumes a 1.5% discount rat^e, and $213 if one assumes a 15> discount 
rate'. ^ " ^ 

Transmission costs . Our estimate of transmission costs is 
based on the tariff of Radio Corporacion , a private broadcasting station 
whose transmitter covers much of Nicarai^ua. Their charge per 20-minute 
slot between 5:00 a.m. and 9:00 a.m. is $1^.50; between 9:15 a.tn. and 
11:^15 a.m. it droos to $11-50. There is a 10? distcount for a one-year 
contract, which would be advantageous for the RMP if such contracts 
allowed for less frequent than daily use. For subsequent' calculations 
we assume a cost of $13.00 to broadcast a 20-ininute; lesson. 

. Reception site costs . The present (1975) reception sites utilize 
cassette players because the small number of sites in the first develop- 
mental year fails to justify use tff broadcasting. Current reception 
costs are thus little guide to future ones, and the costs presented 
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^ below simply reflect present project estimates. The cost estimates 
we present attempt to include all elemerfts of cost associated with 
operational introduction of the RMP, including teacher training costs, 
supervision costs, and printed material costs. 

Table 28 categorizes reception site ^!Ost estimates into three 

Mparts. The first part consists of costs conpon to an entire school, 
in this case supervision costs; assuming '3 parMcipating classes per 
school and 35 students per class, supervision costs-*come to $.74 per 
student per year. This number is, of course, highly sensitive to the 
number of supervisor visits per school per year, and it will be .important, 
as the project progresses, to ascertain what an adequate mlnimiim number 
is. The second cost category consists of those costs common to a 
classroom; these costs are estimated to be $38 per classV.oom per year 
or $1.09 per student. A total of $32 out of the $38 classroom costs 
are for teacher training apd 'the, radio set, both of which would 
presumably not be increased with additional curriculums. Possibilities , 
for savings ►here include sharing of radio sets among classrooms and 

providingjjteacher training less frequently than annually. The third 

> 

category of costs is for student materials; these are estimated to cost 
$2.00 per student per year. Utilizing less than one page per day of 
worksheet^ material would result in substantial cost savings.. 

Cost Function for the RMP 

Our cost function for the RMP will be constructed to give 
annualized total cost, TC> as a linear function of two independent 
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* Table 28 

Reception Site 'Bbsts (per 150 Lessons) 

I. Costs Common to Entire School $ 78.00 

supervisor visits (N is number of 
supervisor visits per school per 
academic year; assumed cost per 
visit is 1 day of supervisor time 
at $11 plus transportation at $2.) 

We assume N = 6. - - ' 

II. Costs Common to Classroom 38.00 

1. radio set at $50 with 5-year life time $12 ^ 

a. annualized cost at OJl = $10/year 

b. annualized cost at 7.5* = $12/year 

' c. annualized cost at 1551 ^ $15/year 
(table use 7.5>{ discount rate) 

a 

2. batteries ,5 

3. teachers guide (100 pp) ^ X 

i|. teacher training (10 hours per year 20 

at $2/hour) ' i 



This assumes ah average of 10 hours of playing life per battery 
costing $.35; these battery lifetimes are within the range of those 
cited in a recent Consumer Reports survey (v. 40, July, 1970, 
pp. 436-439). 
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Table 28, continued 

III. Costs Individual to Students 2.00 

1. - blank paper (0 - 1/2 pages per $ .10 

lesson; assume 40 pages per year 
at 1/4 cent per page) 

2. workbook (1/2 to 1 page per lesson; 1.50 
assume 150 pages per year at 1 cent 

per page 

3. miscellaneous supplies .40 

IV. Cost Summary 

Assume: 1. 3 participating cl^srooms per school 
2. 35 students per class 

Per-student Reception Cost is $ 3^83/year 

» 

or .,026/lesson 
or .077/hour 
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variables— the number of lessons presented per year,, H, and the number 

of students enrolled in a course, Each enrolled student would take 

the 150 lessons of a^ single year's course. The cost function we are 

assuming has, then, the following form: 

TCra+aH + aN, 

0 12. ^ ' . 

where a , a , and a are oarameters we can determine from the cost 

0 12 

» * 

data of the preceding subsection. 

The first parameter, a , consists of all cost components 

0 ^ ^ 

invariant with respect to hours of programming or student usage, i.e., 

it consists of central project costs: 

a = annualized- start-up costs + project administration 
0 costs + (research costs). 

We have placed research costs in parentheses because we feel it dubious 

that these general research costs should be included in the Nicaragua 

cost function. As most of the research covered Dy these costs has 

results directed outside Nicaragua, we will exclude these research 

costs from our total cost equation; information from Table 26 will 

'allow those who wish to include these costs to do so. (On the other 

hand, we do include the cost of formative evaluation research as being 

directly related to program proiuction. ) Since we annualized start-up 

costs at three different discount rates, we have three values for a 

0 

(-each excluding research costs); 

, $ 75,600/yr if r = 0 

a = $ 91,800/yr if r = 7.5% 
0 

$112,800/yr if r = ^5%. 
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The next parameter, a , depends on transmission costs and 

V 

program productiorv costs; it^equals the annualized cost of a lessen 

pius the cost of transmitting it once. The annualized cost of a lesson 

is $107 at a 0 discount rate; $160 at a 7.55 discount rate; and $213 at a 

1 

15% discount rate. The cost of transmission is $13. Thus we have 



$120/yr if r = 0 

a = $173/yr if' r = 7.5% 
1 

$226/yr if . r = 15%. 



The final cost parameter, a , depends only on the cost per 
• 2 ^ 2 

enrolled student per year. From Table 28 we see that a = $3.83/yr. 

2 

Our final cost .equations are, then, given by (in dollars per year) 



75,600 + 120 H + 3.8 N if r = 0 
TC = ■ 91,800 + 173 H + 3.8 N if r = 7.5% 
112,800 + 226 H + 3.8 N if r = 15%. 



This assumes that each lesson Is broadcast only once per year. 
The relatively small cost of transmission suggests, if there were either 
pedagogical advantages for repeat broadcasting or advantages to shifting, 
that the resulting increases in transmission cost would be relatively 
slight. 

2 

Strictly speaking, a = $3*83 if r = 7.5%; we assume, however/ 

2 

that a is not dependent on r because the cost implications are so slight, 
2 
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Average Costs 

The .above equations can be used to compute the average cost of 
radio per student per year, AC, and the cost pen,, student-hour of exposure, 
PHC, as a function of the values of H and N. Table 29 shows the results 
of computations of thAs sort for tw^ values, of H--450 and 900— and several 
values of N. This table uses the cost function that has a 7.5% discount* 
Since there are 150 lessons per year, a value" of H = 450 implies radio 

coverage (in mathematics) for 3 grade levels; H =r 900 \implies radio 

\ 

coverage for all *6 elementary grades. 

Even with between 10,000 and 50,0.00 users the average costs remain 
substantially above the marginal cost of $3*80 per student per year. And, 
because of both high marginal costs per student and high programming 
costs, the costs of the RMP are substantially higher than for other radio 
projects and fall in the range of instructional television costs. 

Discussion 

Three basic points emerge from the analysis just presented of the 

costs of the RMP in Nicaragua: ^ 

1. The intensive efforts put into program preparation suggest 

« 

that, unless careful effort is undertaken to make these programs available 
to many users, the^^ost per student of program production will be - 
extremely high. The, costs can be spread among Users by insuring a long 
life (10+ years) for the programs, by implementing the RMP through all or 
most of Nicanagua, and by attempting to use .the same programs with only 
slight revision for Spanish-speaking students in Latin America and thfe U.S. 
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Table 29' 

a 

Average Costs 

H = 1*50 H s 900 \ 

. . , X 
b c 
' AC PHC , . AC PHC 

N ' . 

2,000 89 1.78 128 2:56 " 

10,000 21 .42 29 .58 

'50,000 7 . .m 9 .18 

250,000 ^ 4.5 .09 4.8 .10 > 

a ' ' 

These average costs, are computed from the cost function that has a 
discount rate of 7.5){. . ' 

b 

AC stands for the average cost per student per year in dollars. 

o ' ' , 

PHC stands for the per-hour cost of instruction per student; as there 
are 150 20-fflinute lessons per. year, PHC = AC/50. 
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2. The presently planned levels of classroom supervision, 
teacher training, and student worksheet usage result in per student ^ 
reception costs of $3,80 per year, or, assuming 150 20-minute lessons 
in a yeir, cost of tTy ceh|:s per student-hour. These costs _are 
exceptionally high, suggesting the value of continued, careful 
experimentation with lower levels of supervision, less frequent and 
less intensive ,teachen training, and more limited worksheet use. 

3. It appears possible to reduce substantially the reception 
site costs and to spread programming costs over a large audience. Even 
if this is done, the project is apt to remain expensive by the standards 
of instructional r^adio projects. For this reason, principal emphasis in 
evaluation of the RMP must be placed on its capacity to improve the 
effectiveness of instruction., as indicated by its effects on mathematics 
.achievement test scores and student repetltioa r^tes. It is too early ^ 
in the project to assess its performance along these dimensions. 

V - - 
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Chapter & 

4 

Other Research Activities . 

In this chapter we report briefly on three other research 
activities the project currently has underway. The first is the 
standardisation of a mental arithmetic test developed during the past 
year at the Institute. The second is the administration of an attitude 
questionnaire to first-grade teachers in Nicaragua. The third is 
a study of the determinants of repetition and dropout in Nicaragua. 

standardization of the Primary I Stanford Mental Arithmetic Test 

During the past year a 'set of tests for assessing ^achievement 
in mental arithmetic, the Stanford Mental Arithmetic Tests (SMAT),*were 
developed and normed using California elementary school children. 
T^is work is described fully in Sachar (1975). Preliminary work on 
no^raing the test in Nicaragua was begun in May, 1975 ^ 

The SMAT consists of six pairs of tests, two formis for each 
of Grades 1 through 6. Each test is a domain-referenced test whose 
content is determined by defining a curriculum and sampling from the^*^ 
curriculum. The Primary tests, for Grades 1, 2, and 3, contain 
addition, subtraction, and number concepts exercises. Each SMAT test 
Gpv^i:^s exercises ranging from' those that all of the students in the 
appropriate grade level/ can answer correctly to those that rto student 
can answer coi*r^ctly, with items presented in order of increasing 
difficulty. The Primary I test, which is being used in the^ work in 



Nicaragua, contains 100 items, divided into sections of ten items each. 

nie SMAT tests are administered using a prerecorded tape.whicli. 

contains instructions and test items. All exercises require free 

responses which are made on a printed answer sheet. The tjaped .test* 

- ' (J ' 

is about 35 minutds long. , - 

• Because we were able to devote only a small amount of staff 

^ t- * 

time in Nicaragua to this task, we decided to work this year with only 
one SMAT test. Primary I, form A. The staff 'produced^ and pilot-tested 
several preliminary versions, resulting in a final version that will 
be administered later this year to students at six grade levels* 

As a first step, the United States (US) version of the test 
was translated into Spanish by a Nicaraguan staff member and 
administered to second-grade students in a rural school in Masaya. 
The children had difficulty following the answer sheet and many did 

» 

not understand the directions* These children had never taken a 
^Standardized test and were not familiar with tape recordings in the 
classroom. 

Thfe instructions were rewritten and the taped introduction was 
expanded to include more practice in finding the lettered identifiers 
on the answer sheet. In addition, a lO-mipute lesson teaching the five 
letters used as identifiers was written, to be delivered by the 
administrator prior tQ starting the tape recorder. This revision was 
administered to first- and second-grade students in two rural schools. 
When it was found to be satisfactory, the lesson on letter identification 
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was incjorporated into the taped introduction and the number of sample 
items was' increases from five to ten, to give practice on an entire 
section, using all exercise ' identifiers. 

These first two test versions were used to establish an adequate 
introduction to the test. The last and final revision dealt with the 
problem of translating the exercises. The wording of exercises for the 
US version of the test was determined by adopting a standard translation 
from the written form of an exercise to its oral form. For example, 

2 + 3 = becomes "What is '2 plus 3?>" and 2 + — = 5 becomes "2 plus 

a 

what equals 5?" Because there was some disagreement among Nicaraguan 
* *' , 

staff members about the wording of questions, we decided to use this 

same procedure , to d.etj^rmine the spoken jSpanish form, that is, to 
< 

translate from the written mathematical form into the spoken Spanish 
form. 'We strove to find the expression that would be most easily 
understood by the children without explaining how to solve the problem. 

Four Nicaraguan staff ^members (three of them former classroom 
teachers) participated in the translation process. AlthoUgh there 
was initially some disagreement amonc; tnem, they produced a verbal form 
for each exercise. Table 30 shows, for each exercise type, the written 
form, the Spanish form and its English translation (which is not 
necessarily the same as the Efiglish form of the question). ^ 

♦ # 

9 

The body of the final Nicaraguan version of the test parallels 
the US version. Each of the 100 exercises consists of the name of the 
identifier, the question, and a six-second pause. The questions are 
arranged in ten 10«item parts with a one and one-half minute break 
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T^ble 30 

Written and Verbal Forms of SMAT Test Itfems 



Spanish Ehglish translation^ 

form of Spanish form 



Cuanto es dos mas 
tres? 

Pes mas cuanto es 
igual a cinco? - 

Que numero mas tres 
es igual a cinco? 

Cuanto es cinco menos 
tres? 

Cinco menos .cuanto es 
igual a dos? - 

Que numero menos tres 
es igual a dos? 

Cuanto es cuatro por 
dos? 

Cuatrp por cuanto es 
igual a ocho? 

Que numero por dos es 
igual a ocho? 

Cuanto es seis^ entre 
dos? 

Seis dlvidido entre 
cuanto es igual a tres? to 3? 

Que numero divldido What number divided by 2 is 

entre dos es igual a tres? equal to 3? 

A cuantos sextos son To how many sixths is two-thirds 
iguales dos tercios? equal? 




How much is 2 plus 3? 

2 plus how much is equal to 5? 




- How much is 5 minus three? 



5 minus how much is equal to 2? 

What number minus three is 
equal to 2? 

» 

How much is 4 times. 2? ' 

4 times how much is equal to 8? 

f 

What number times 2 is equal to 
8? 

How much is 2 into 6? 
6 divided by how much is equal 



Table 30, continued 



Wnitten 
fprm 

1/3 + 1/6 = 



Spanish, 
form . 

Cuanto es un tercio 
mas un sexto? 



English translation 
of Spanish form 

How piuch is one-third plus' 
one-sixth? - . 



2 6 



Cual numero es mayor, Which number is greater, 2 or 6? 
el dos o el seisT* " 



7 ^ 



.7 9 



Que numero va cfespues 'What number goes after 7? 
del siete? 



Que numero va antes Wha^ number goes before 7?^ 
del siete? 

Que numero va entre What number goes between 7 and; 9? 
siete y nueve? . , 



'123 



.122 



after parts .4 and 8. As noted above, the introduction of the Nicaraguan 
version is lengthier and includes ten sample exercises rather than five. 

A sampling plan was developed to norm the Spanish SMAT using 
Masaya public school children in Grades 1 through 6. We decided not 
to sample the entire country because we learned from the Bureau of 
Research, in the Ministry of Education, that the phrasing of mathematics 
problems varies In different parts of the country, In particular, on 
the eastern and western coasts. All six grades are^ included to assess 
achievement levels for children completing primary school, a natural 
stopping point in their educatior^ for a large number of Nicaraguans. 

''rhe public schools in Masaya were/ divided into regional strata, 
urban, rural, and municipal, as described elsewhere in this report. 
The test population will consist of approximately 150 students from 
each grade level, selected from each stratum in proportion to the grade 
population. In the urban and municipal schools, students from a single 
grade will be sampled separately. Because of the small number of 
children in many grade's in the rural schools, rural children Will be 
sampl'ed using two grad^ at a time,- 1 and 2, 3 and 4, and^ 5 and 6,^ 
attempting to maintain approximate proportions by grade in the stratum. 
The test population for each stratum will be formed by sampling clashes 
at random until the r^Vjuired number of students is obtained. In making 
the .calculations we assumed that approximately 60 percent of the 
children chosen will actually be tested. Each pair of grades will 
be tested during a one-month period between July 1, 1975 and the end 
of the school year in November. ^ 



Teacher Att.itu.de Study 

A questionnaire was developed to investigate those attitudes 
ot teachers that might be influenced by exposure to the radio 
mathematics program. The instrument was designed to assess attitudes^ 
in four areas, the subject matter of mathematics, teaching of 
mathematics, use of instructional radio, and teaching as a profession 

The questionnaire Was administered to teachers in November, 
197H, before the initiation of radio lessons, in order to obtain 
baseline data. It will be used again at the end of the 1975 school 
year, and then a*t the 'be^inning^and. end of each succeeding school 
yecU?,. In addition to providing evidence for attitude changes over 
time, the data will be used to look for correlations between teacher 
attitudes, their background characteristics, and the achievement 
level of their students.* " " 

The questionnair*e has two types of items. ^. Most items 
present a statement' and ask the teacher to indicate his level of 
agreement, using a 5-point Likert scale. The remaining items are 
incomplete sentences that the teacher is asked to complete. 

We chose the Llkert-scale format becaus-e it is direct and 
easjr for teachers to U3e. However, it is also subject to deliberate ' 
bias on the part of the respondent. We felt that the possible bias, 
while/^Significant in aOiabsolute way, would not affect the value of 
the questionnaire as, a tool for comparative study. The incomplete 
sentence ,technique is useful because it gives teachers an opportunity 
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to respond in q le^is structured way to the themes of the questionnaire. 
We also pilot-tested items using a semantic differential technique, 
and conc;iuded that these would not provide additional information. 

The questionnaire was given to the 44 teachers whose classes 
were given the 1974 achievement test. The process of developing the 
questionnaire, and Its contents, will be descirlbed in a forthcoming 
publication, that will also discuss the resultss^of the first 
administration last November. 

Determinants of Repetition and Dropout Propensity in Nicaragua 

This study is being undertaken by Dean Jamison of Educational 
Testing Service and. Kathleen McNally, of Rutgers University. The 
study is part of the- project's evaluation of the effects of radio 
instruction on student achievement and is designed to ascertain 
whether the introduction of radio will have an^* impact on students' 
propensity to repeat grades or drop out. Data collection and 
modelling efforts are now underwayvfor two sets of data on first 
grade students* The first data set involves. 1600 students who were 
in first grade in the Department of Masaya during the school (and 
calendar) year 1974, prior to the introduction of radio in3truction. 
The second data set will involve about 800 first grade students 
from Masaya in 1975; 600 of these 800 will receive their mathematics 
instruction .by the preliminary version of the radio curriculum. 



Chapter 9 , 
Plans for 1975-76 

The 1975-76 project year ^ncompasses the end of the present 

academic year and the beginning of the next. 'School will end in raid- 

u 

November and commence in mid-February.. Our plans for this coming 
year have changed since the formulation of the. ilfiitial research plan 
for the project, in response to our experience in the field. We now 
plan only a partial revision of the first-grade lessons for next year. 
With some extension and revision, we will broadcast the lessons that 
were recorded this year, carrying out the summative evaluation as 
planned* We will also, as planned, develop lessons for Grade 2. 
In this Chapter we discuss some of the factors contributing to this 
change of plans. Then we present a short description of the other 
project activities that we expect to undertake in the coming year* 

We have two reasons for deciding to delay a full curriculum 
revision until the following, year^ The first is that the staff does 
not yet have sufficient training and strength to produce two lessons 
a day, the number required if we develop second grade and fully revise 
first grade. The second reason is that it is only now that we feel we 
are beginning to collect the data we need for a rational revision and 
to conceptualize the revision process in a useful way. As a result, 
we do not have the kind of data we need to revise the first grade 
lessons. The lessons have proved for ti\e most part satisfactory, 
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and are certainly adequate for broadcasting. We will, next academic 
year» collect the appropriate data to allow for a substantial, data*- 
abased revision. 

As indicated in the body of this report, the worksheet data, 
on which we planned to rely as a sole source of ' information about 
performance levels during the school year, has turned out to be far 
more contaminated than we had anticipated. Therefore, we have, within 
the last month, instituted weekly paper-and-pencil tests in five 
classrooms. Each test contains 10 items and a matrix sampling design 
allows us to coll^t^data-^on^O— ttems^achrwg^. He have established 
procedures for administering tests that greatly reduce the copying and 
elimihate help provided by the teacher, We feel that these tests will 
give us a stronger data base for planning curriculum revision. 

In addition, our methods of observing classrooms have changed 
substantially during the year, and we are not yet satisfied that we 
have ^eveloped the most useful scheme. We plan, during the rest 
of th^ school year, to continue to revise the observation form. 

For the partial revision of first-grade lessons in preparation 
for thjeir use during 1976 we plan_tp_do^^the--fol'liD^^ 

1. ^rite five lessons to precede the first radio lesson 
presenbed irt 1975* These lessons will cover the introductory material 
teachers werp asked to present last year during the first three weeks 
of schqol. ^e anticipate qsing these lessons during the first full 
week or school. 
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2* Write the missing lesspns (two each week for the first 
four weeks) that the staff was unable to produce last year. 

3. Write ten lessons to be presented after the last 1975, 
lesson, thereby extending the instructional material by two weeks. 
The time for these lessons will come from the two weeks saved at the 
beginning of the school year. 

4. Rewrite five to ten lessons that the staff this year found 
unsuccessful. ' 

The first-grade radio lessons will be used in approximately 
45 classrooms. The children in all of these classrooms will be pre- 
and posttested. Thirty of the classrooms will be randomly selected 
from among schools that were not used for experimental purposes this 

e 

year. These 30 classropms will receive the experimental treatment 
which, in addition to pre- and posttesting, consists of teacher training 
and the provision of materials and radio lessons. These classes will 
not be observed nor will the children be given interim tests. Five 
additional classes will be chosen (randomly) for observation and testing 
purposes. In addition, we plan to give the 17 teachers who participated 
in this year's experimental work the option of using radio lessons in 
their classrooms. We anticipate that approximately 10 of them will 
do so, bringing the number of classrooms to about 45. Twenty control 
classes will be selected randomly, and will be pre- and posttested. 

We plan to choose 9 experimental second grade classes to 
participate in the pilot-testing phase of curriculum development. 
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three each from rural, municipal, and urban settings. Roughly half 
of these will be classes that have substantial numbers of children 
who received radio lessons in first grade • Because of the mobility 
of students and the high repetition rate, we cemnot expect second- 
grade students to have used radio lessons, even with more, widespread 
use of the program, and we plan to write second grade lessons so they 
will be suitable for both experienced and inexperienced children. 
The experimental classes will be observed and tested according to a 
schedule similar to that in .use at present, . 

We plan to continue developing and administering tests • The 
full testing schedule for 1975-76 includes the following* 
» 

Date Test administered 

July - October, 1975 Mental' jLriJtlimeti<j test 

November, 1975 First grade year-end test 

16 experimental classes 

9 non-rpHio classes (pretested) 

Second grade year-end test 

16 randomly selected second 
grade classes 

Feb^ary, 1976 TOBE pretest 

45 radio classes 
?0 control classes 

Second grade entry-level skills 
9 experimental^ classes 
9 non-radio ^classes 

The second grade year-end test will be written by the project 

staff and is designed to provide information about the achievement 

level of traditional second grade classes, to aid in curriculum 

development. 
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We have proposed to the Ministry of Education that for I976 
they increase the level of support to the project. For 1975, the 
Ministry supports 11 staff positions, 7 of them professional. For 
1976 we are asking for support for 2^ positions, 15 of them in the 
professional category. Thus, we are asking the Ministry to support 
our present staff. We plan to continue recruiting for all professional 
positions, and consider hiring and training more script writers to 
have the highest priority. 

Two staff members have applied for (and will probably receive) 
fellowships to attend an eight-month OAS training course in writing 
and producing instructional programs for TV^aryL radio-. -The^'coiTrse^ 
^aljoj5jtiavlde3--som"e'tr^ in techniques of evaluation. The first 
five months of instruction are at the Centre Multinaciohal de 
Tecnologia Educativa in Mexico, the remainder at a similar center 
in either Brazil, Chile, or Colombia. 

We are limited in the opportunity to provide training for staff 
members at Stanford because almost none of the Nicaraguan staff members 
speak English. We plan to bring Mrs. Vrooman, who speaks fluent 
English, to Stanford for some portion of the next project year. 

The project is becoming well-known in Nicaragua and has 
received several visitors through the Ministry of Education, from 
Nicaragua as well as from other Latin American countries. We feel 
we are well established and look forward to productive second year 
in Masaya. 
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' APPENDIX A 
Data Tables 



segment 



Tai)le I 

Content of Pilot Lesson Segments 

a 



, Lesson & Strand Presentation 



mode 



Description 



L1-.1 


NUH 


0 


Mando*mando giame 


L1-2 


NUM 


0 


Counting aloud 


L1-3 


NUM 


\ 0 

1 


Counting sounds 


L1-4 . 


NUH 


W 


/Number dictation 


L1-5 . 


NUM 


0 


/ Successors 


L1~6 b 


APL 


0 


/ Da^s of the week 


L1-7 P 


GEO 


0 


Comparing lengths 


L1-8 P 


NUM 


0 


Mando«>mando game 


L2-1 


NUM 


0 


Mando-mando game 


L2-2 


NUM 


0 


Counting aloud 


L2-3 


APL 


0 


Comparing lengths 


L2-4 


BAS 


w 


Identifying common objects 


L2-5 


NUM 


w . 


Number dictation; 


L2-6 


NUM 


6 


Successors 


L2-7 


BAS 


w 


Identifying common- objects 


L2-8 P 


At»L 




Measuring with rulers 


L3-1 


NUM 


0 


Mando-mando game 


L3-2 


NUM 


0 


Counting aloud 


L3-3 


NUM 


0 . 


Counting sounds 


L3-4 


BAS 


w 


Identifying common objects 


L3-5 


NUM 


0 


Successors 


L3-6 


NUM 


w 


Successors 


L3-7 


GEO 


w 


Circling, longest, shortest , 


L3-8 P 


APL 


w 


Measuring, with rulers 


L4-1 


NUM 


9 


Mando-mando game 


L4-2 


GEO 


w 


. . Circling longest, shortest 


m-3 


NUM 


0 . 


Successors 




NUM 


w 


Successors 


lH-5 


BAS 




Identifying common objects 


L4-6 


GEO 


w 


Drawing longer, shorter lines 


m-7 P 


APL 


w 


Measuring with rulers 


m-8 P 


APL 


" 0 


Comparing lengths ' 
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Table I, cont. 



Lesson & 
segment 



Strand 



Presentation 
mode 



Description 



L5-1 
L5-2 
L5-3 

L5-5 
L5-6 
L5-7 
L5-8 
L5-9 



NUM 
NUM 
APL 
APL 
ADD 
ADD 
ADD 
APL 
APL 



0 
0 
0 

w 

0 
0 

w 
w 
w 



Mando-roando gcime ' ^ 

Counting aloud 
Comparing coins 
Identifying coins 
Story problems — addition " 
Mental arithmetic 
Mental arithmetic 
Measuring with rulers 
Drawing lines of given length 



L6-1 
L6-2 

L6-3 ■ 
L6-«» 
L6-5 
L6-6 
L6-7 P 



NUM 
ADD 
ADD 
APL 
APL 
APL 
■APL 



0 
0 

w 

H 
0 

w 
w 



Counting aloud 
Mental arithmetic 
Mental arithmetic 
Comparing coins 
Comparing coins 
Story problems—money 
Giving value of coins 



W = written, 0 = oral-. 

P means presented after the taped lesson (postbroadcast) . 
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/ Table II 

s 

Pilot T^st Results by Item 



a b 



Item 


Strand 


H 


Percentage 


Identifier 






Correct 


A1 


NUM 


91 


. 9'<.5 


A2 


NUM 


91 


93. 


A3 


NUM 


91 


63^7 


A4. 


NUM 


91 " 


39.6 


.A5 , 


SUB 


91 


52.7 


A6 


"APL 


91 


75.8 


..A7 


ADD 


91 . 


5^.9 


A8 


SUB 


91 


24.2 


A9 


ADD 


91 


• 58.2 


A10 


SUB 


91 


27.5 


B1-1 


NPM 


\ W 


87-8 


B1-2 


NUM ' 


41 


46.3 


B1-3 


NUM 


41 


39.0 




ADD , 


41 


43.9 


B1-5 


DIV 


41 


22.0 


B1-6 


APL 


41 


14.6 


B1-7 


APL 


41 


63.4 


^ B1-8 


' NUM 


41 


65.9 


B1-9 


APL 


41 


41.5 


B1-10 


NUM 


41 


17.1 


B2-1 


GEO 


50 


92.0 


B2-2 


NUM 


* 50 


86.0 


B2-3 


NUM 


50 


72.0 


B2-1 


NUM 


50 


50.0 


B2-5 


NUM 


50 


22.0. 


B2-6 


APL 


50^ 


20 . 0 


B2-7 


NUM 


50 


52.0 


B2-8 


NUM 


50 


78.0 


B2-a 


APL 


50 


84.0 


B2-t0 


NUM 


50. 


58.0 


C1-1 


NUM 


17 


64.7 


C1-2 


APL ' 


17 


5.9- 


C1-3 


ADD 


17 


23.5 


■ C1-1 


ADD 


17 


35.3 


C1-5 


MUL 


17 


35.3 


C1-6 


MUL 


17 


29.1 


C1-7 


GEO 


17 


11.8 


C1-8 


SUB 


• 17 


11.8 


- C1-9 


ADD 


17 


0.0 


C1-10 


SUB 


17 


11.8 ? 
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Table II, cont. 



Item ' 


Strand 


n 


Percentage 


Identifier 






Correct 


C2-r1 


HUM 


18 


5.6 


C2-2 


GEO 


4 Q 

10 




C2-3 


ADD 


18 


50*0 


C2-4 


SUB 


18 


27.8 


C2-5 


SUB 


18 


22*2 


C2-6^ 


DIV 


18 


0.0 


C2-7 


SUB 


4 O 

18 


22.2 


. C2-8 


ADD 


4 O ' 

1o. ' 


5.0 


C2-9 


MUL 


4 O 


, 22.2 


C2-10 ' 


ADD 


4 0 

1o 


n n 
U« U 


C3-1 


NUM 


18 


11.1 


C3-2 


APL 


18 


• 27«8 


C3-3 


NUM 


4 O * 

18 


00.7 


C3-^ 


SUB 


•18 


4 £ rr 

15. 7 


C3-5 


MUL 


4 O 

18 


30.9 


C3-0 


MUL 


40 * 
18 


22.2 


C3-7> 


NUM 


4 0 

18 


IO.7 ♦ 


C3-8 


MUL 


18 




C3-9 


NUM 


18 




C3-10 


SUB 


18 


0.0 


C4-1 


NUM 


20 


45.0 


C4-2 


APL • 


20 




C4-3 


NUM 


20 


70.0 




SUB 


20 




C4-5 


SUB ^ 


20 


30.0 


C4-6 


DIV ^ 


20 


20.0 , 


C4-7 


DIV 


20 


0.0' ^ 


C4-8 


SUB 


< 20 


5.0 


CU-9- 


SUB 


20 


0.0 


C4-10 


SUB 


20. 


0.0 


C5-1 


NUM' 


18 , 


33.3 


C5-2 


APL 


18 


22.2 


C5-3 


ADD 


18 


55.5 


C5-4 


SUB 


18 


33.3 


C5-5 


MUL 


18 


22.2 


C5-6^ 


MUL 


18 


11.1 
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Table II; cont. 



Item Strand n Percentage 

Identifier Correct 

C5~7 ) ADD 18 50.0 

C5-8 / ADD 18 - 22.2 • 

C5-9 ADD ,18 , ,5.6 

C5-i0 ADD 18 5.6 



Test items came from forms 'A, B1, B2, CI, C2,. C3,,C4, and C5 
Items are numbered consecutively within each form. p 



Strand abbreviations are . - ' , 

NUM. Number coiTcepts GEO Geometry \ 

. ADD Addition MUL Multiplication 

SUB Subtraction DIV Division . > { 

APL , Applications 



^ ■ ■ 

Table III 

Achievement Test Results by' Item 

Item*^ Strand n * Percentage 

Identifier Correct 



A1 


■ NUM 


1211 


80.82 


he. 




15111 


71 fil 

I 1 • OH 




MTIM 

nun 


15ll 1 


•«lii oft 


A** 


MTIM 


15ll 1 


7fi ■ ft? 


A!) 


MTIM 
NUW 


1 5ll 1 


7Q '57 


AA 
AO 


^ OUD 


15ll 1 


lio ftn 


A7 

A \ 


inn 


1?li 1 




B1-1 


NUM 


246 


^- 91 -46 


n 1 o 
D 1-^ 


Ann 

AUU 






n 1 ^ 


ADt 






D 1 \\ 
D I-** 


ilTIM 

nun 




. lU 










D i A 


MTIM 




97 7fi 




QTTn 




Pt^ 71 


B2-1 


NUM 


265 


87.55 


DO O 


criD 




V An nn 
. ^ DU • uu 


B2-3 


A Dt 

A PL 


»20D 


7n lo 




NUM 




lin nn 
**u • uu 


B2-5 


GEO 




oft ft7 


82-0 


NUN 




70 


DO 

B2-7 


criD 
oUd 




oo "77 


B3-1 


NUM 


22? c 






Ann 




67.71 


B3-3 


APL 


223 


71.30 


B3-1 


NUM 


220- 


80.15 


B3-5 


GEO 


223 


95.96 


B3-6 


NUM 


223 


38.12 


B3-7 


SUB 


223 


7.62 


Bi4-1 . 


NUM 


210 


73.75 


B1-2 


. SUB 


210 


13.33 


B4-3 


APL 


210 


19.58 


Bl|-J| 


NUM 


239 


82.85 


B1-5 


GEO 


210 


80.83 


Bl-fr' 


NUM 


210 c> 


11.25 


B1-7 


SUB 


239- 


25. 10 

i 


B5~1 


NUM 


267 


66.67 
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Table ^III, cont. 



Item Strand 
. Identi/^i^ 



B5-2 


ADD 


B5-3 


APL 




NUM 


B5-5 


GEO 


B5-6 


IIUM 


JS.B5-7 


MUL 


C1-1 


NOM 


C1-2 


.APL ■ 


Ct-3 


NUM 




APL 


CU5 


ADD^ 


C1-6 


SUB 


C1-.7 ■ 


MUL 


C2-1. 


,NUM 


02^2 


APL 


. ' C2-3 


^ NUM 


C2-4 


APL 


' C2-5 


ADD 


C2-6 • 


SUB 


C2-7 ' 


ADD 


C3-1 


NUM 


C3-2 


APL 


C3-3 


NUM 


C3-'» 


' APL 


C3-5 


ADD 


C3-6 


MUL 


C3-3 


SUB 




NUM 


Cij-2 


APL 


Ci»-3 


NUM 




APL 




ADD 




ADD 


C4-7 


SUB 


• C5-^ 


NUM- 


C5-2 . 


APL 


C5-3 , 


NUM 


. C5-1J 


' APL 


C5-5 


ADD 


C5-6 


MUL 


C5-7 


SUB 



ri . Percentage 





Correct 


267 


50.94 


267 


52.43 


266 


37.59 


267 


73 . 03 


263 


64.26 


267 


26.22 


2HQ 


41.94 


2i»8 


31.05 


zm 


47.98 


2l}8 


. 37.50 


2^8 


60.48 




35.48 


248 


25.00 


255 


18.43 


255 


36.08 


255 


56.47 


255 


38.82 


255 


47.45 


255 


28.24 


255 


11.76 




16.46 ' 




5.35 


2^^ 


60.08 




2.88 


243 


27.57- 


243 ■ 


43.62 




35/. 80 




49.59 




,40.24 


'246 


/47 . 97 


246 • 


/ 56. 10 


246 


■ / 47.97 


246 


.' 4i;87 


246 


/ 31.71 


249 


• 20.88 


249 


.' 35^.74 


249 


• ■ 36.14 


, 249 


8.84 


^ 249 


47.39 


249 


38.55 


249 


21.69 



f 

' 138- 



Table IV 



Class Means Using Total Scores Estimated 
by Kleinke Procedure 



a 



Class 


Region 




. Mean 


Standard Deviation 


1 


0 




31 


142. i{2- 


11. ?3 


2 


u 




37 




9.33 


3 


u 




36 


38.81 


i 12.05 


. i| 


u 




28 


1J1.29 


11.93 


5 


u 




31 


32. '<2 


12.1J1 


6 


u 




31 


31. 


11. H6 


7 


u 




27 


3'<.07 


11.99' ' 


8 


M 




33 


30.79 


^2.75 


9 


M 




27 


•35.19 


U.05 


10 


R 




22 


33.32 


\ 1 1 . '<5 


n 


U 




32 


3frf88 


12.7'< 


12 


M 




27 




11.08 


13 


M 




28 


1J2.00 


10.7'< 


14 


U 




27 


32.01J 


13.19 


15 


R 




13 


23. 'je 


10.13 


16 


R 




31 


30.53 


13.61J 


17 


U 




21 


35. 2H 


12.25, 


18 


R 




29 


38.07 


12. 17 


19 


R 




19 


21J.16 


lO.lJO 


20 


M 




11 


33.95 


12.1J0 


21 


R 




16 


33.75 


9.95 


22 


R 




38 


37.26 


111. 17 


23 


M 




21 


30.50 ' 


12.21 


2i| 


M 




28 


ljll.18 


12.27' 


25- 


M 




45 


J8.56 


12.51 


26 


M 




33 


28.70 


10.35 


27 


R 




22 


1<0.59 


11.18 


28 


M 




21 


37.71 


11.25 


29 


R 




41 


36.3'< 


11.00 


30 


R 




29 


35.1J5 


11.71 


31 


U 




22 




11.61J 


32 


U 




33- 




10.08 


33 


U 




in 




10.1J7 


3il. 


U 




30 


IJO.07 


13.62 


35 


R 






1J1.19 


12.1J3 


36 


M 


b 


* 21 


33.52 


1 1 . 82 


37 


" U- 


•Radio 


25 


37. '<8 


12.61J 


38 


R- 


•Radio 


25 


1J1.08 


1 1 . 72 


39 


M- 


•Radio 


2H 


38.00 


11.85 
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Table IV, cont. 



a 



Class 


Region 


n 


Mean. 


Standard Deviation 


40 ■ 


R-Radio 


32 


4i.25' 


10.62 


41 


U-Radio 


29 


47.24 


11.39 


42 


M-Radlo 


22 


30.50 


10.09 


43 


U 


35 


34.29 


12.62 


44 


R 


19 


41.68 


13.74 



Note. Classes 1-30 were selected randomly, 
a 

U = urban, M = municipal, R = rural, 
b . . 

"Radio" classes were used to try out pilot 'lessons. 



f 



N 

\ 
\ 




\l 



APPENDIX B 



First-Grade Achievement Test, 197^ 



Question Item 
nuaber identifier 



1 



A1 



Printed 
component 

13 cats, 7 white and 
6 black 



Oral 
component 

•*Count the ^ite cats." 



A2 



B1-1 

B2-1" 

B3-1 

BJl-1 

B5-1 

B1-2 
B2-2 
B3-2 
BJl-2 
B5-2 

C1-1 
C2-1 
C3-1 

C5-1 

A3 



B1-3 



2 bags of caramels, 
one containing 17 
caramels, the other 
containing 15 

Blank line 
It 

If 

It 

If 

Blank line 
It 

It 

If 

If 

ioiojio • 

^ Jt_6 

«ilO 1£ 

iznii 

^ JL^ 

2 coins-- 50 cents 
and 5 cents* Multiple 
choice— 50, 55, 
cents. 

Blank line. 



••Circle the bag that has 
the fewest caramels 



••Write the number 7" 
40 
15 

200 
53 

"How much is 8 + 4?" 

6 - 3?. 

5 + 1? 
28 - 2? 
20 + 7? 

"Read- the numbers carefully. 
Wri^te the numbers that are 



missing." 



"Circle the number 
that tells how much 
the tvo coins together 
are worth." 

"Maria had 3 hair ribbons. 
Her mother gave her 2 more. 
Write the number of ribbons 
that Maria has now." 



B2-3 



"Martha gave 3 bananas to 
the teacher. Jose gave her 
2 and Miguel 2. Write the 
number of bananas that the 
teacher received*" 



Translated from Spanish 



1i<5 



Question Item Printed 
number • identifier . Qomponent 



Oral 
component 



B3-3 Blank line 



B4-3 



B5-3 



8 B1-i| 
B2-4 
B3-4 
B4-i| 
B5-4 



"Manuel had 4 buttons to 
play with. Playing with 
another .boy he lost 3* 
Write the number of buttons 
he has, left." 



'^I have 2 boxes. In each 
box there are 4 dolls • 
Write the number of dolls 
that I have." 

"Mama has 5 hens. She 
divides them between her two 
children. Write the number 
of hens she gives to each 
child." 

"Circle the figure that is 
Lrfivided into halves." 

"Circle the figune. thsit is 
divided into halvels." 

"Circle the figure that is 
divided into fourths." 

"Circle the figure that is 
divided into halves." 



"Circle the figure that is 
divided into thirds." 



C1-2 Juan had 5 mangos. "Read this problem carefully. 

He ate 2. Circle the correct answer." 

How many mangos 
does he have now? 

3 10 7 
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J - Queatioh Item 

number identifier 




Printed 
component 



ina bought 6 oranges < 
Her mama gave her 
1 more. 

How many oranges does 
Nina have now? 

7 5 

Maria has 6 caramels « 
Pedro has 5. 
Maria has more. 
How many more? 



Oral 
component 

"Read this problem 
carefully . Circle 
the correct answer." 



,70 



ir 3 1 



Dora has 4 dahlias 
and 2 roses. 
How many flowers does 
Dora have? 



2 6 8 

C5-2 Eva has 3 toys. 

Manolo has 3 others* 
How many toys do they 
have between the two 
of them? 



10 





6 


9 3 




C1-3 


80 


73 


91 


C2-3 


52 


57 


59 


C3-3 




3 


5 


C4-3 


, 28l» 


247 


231 


C5-3 


63 


51 


47 



"Circle the smallest 
number . " 
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Question Itei| Printed 
number . identifier component 



Oral 
component 



11 



B1-5 House and 4 dogs 



B2-5 
83-^5 

B5-5 



3 ladders of 
different sizes 

3 trees of different 
sizes 

Nest with 4 birds 
flying around it 

2 glasses 



♦^Circle the dog that 
is closest to the house." 

"Circle the longest 
ladder." , 

"Circle the smallest tree." 



"Circle the bird that is 
flying above the nest." 

"Circle the glass that is 
on the right." 



12 



13 



14 



B1-6 



B2-6 
•B3-6 
Bi|-6 
B5-6 

A4 



A5 



Blank line 



5 boys waiting in 
line to buy tickets 
to the circus. 

FIFTY 
FIFTEEN 
FOURTEEN 
FOUR 



"Write the number that 
comes before 30." 

. . .after. 29. 
. . .before 58. 

.before 46. 
...before 8. 

"Circle the third boy in 
line." 



"Circle the word > 
'fourteen' ." 




iMJ 



Question Item 
number .identifier 



Printed 
component - 



Oral 
component 



15 



C1-4 clock showing 6:00 

C2-4 ... H;OQ 

C3-4 ... 10:30 ' 

Ci4-4 ... 12:00 

C5-4 ... ,2:30 



"Write the hour the clock 
says*" 



tt 
It 
tt 
tt 



16 



C1-5 
C2-5 
C3-5 

C5-5 



24 
21 
+ H^ 

i 30 
+ H 



6 + 10 = _ 
9 



"Read each exercise 
carefully and write 
the correct answer." 



17 
18 



A6 



A7 



5 - 3 = _ 

160 
* g30 
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Question Item 
number identifier 



Printed 
component 



Oral 
component 



19 



C1-6 
C2-6 
C3-6 
C4-6 
C5-6 



6 - 0 = _ 
13 - 8 = _ 

2 X 5 = 

3 + 0 = _ 
5 

2Ll 



"Read each exerci^se 
carefully and write 
the correct answer." 



20 



C1-7 
C2-7 

C3-7 

C4-7 
C5-7 



9 X 10 = 
38 

84 

72 - 1 = 

- 10 



21 



B1-7 

B2-7 

■ B3-7 

B4-7 
B5-7 



90 

- 10 

9'» 

42 

6 - 3 
32 
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APPENPIX C 

Adaptation of Kleinke Procedure for Estimating Student Scores 
Matrix sampling has beenh demonstrated to be a useful method 

4 

for establishing national test norms (Lord, 1962)* Sampling' both 
•examinees and items serves to reduce the amount of testing time 
t^equired of each examinee. Analysis of resultant test data is 
based on the assumption that the sample of items and the sample 
of examinees are drawn independently and that responses to an item 
do not depend on the context in which the item is presented. . 

Although each examinee receives only a portion of the items 
on the' total test, various investigators have attempted to estimate 
parameters of the total test distribution of all examinees. Most 
studies consist primarily of estimates of total->test mean and 
variance (Owens and Stuff lebeam, 1969; Plumlee, 1964). Four studies 
have included estimates of the total-test distribution (Ctook and 
Stuff lebe§m, 1967; L<ird, 1962; Kleinke, 1972; Bunda, 1973)* Lord 
and Cook and Sttif f lebeam fitted a negative hypergeometric 

distribution to three parameters«>«>an estimated mean, an estimated 

J, 

variance, and the number of items on the total test. 

With the exception of Kleinke and Bunda, none of the 
authors estimates total scores for individuals who were administered 
partial tests. Bunda estimated total scores from overlapping item 
samples using a regression equation whose coefficients are found 
from the item means and the item variance-covarlance matrix. The 

1^147 



vector of regression weights, b(T,i), for. any particular sample is 

. -1 

b(T,i) = s(iJ) s(T,i) 

where s(i,j) is the ij-th element of the inverse of the inter-item 
variance-covariance matrix, and s(T,i) is the vector of item-total 
covariances. 

kleinke offered a method for nonoverlapping item samples 
using a linear prediction approach for generating the estimated 
total-test distribution. With this approach, the total-test 
nay be considered a composite of two tests, X, consisting of the 
items presented to the student, anS Y, the items not presented to 
the student. The observed score on X is used to predict the 
SQoi^e on Y. The predicted total-test score is then the sum of 
scores\on X and Y. 

Hie 1974 achievement test had three parts. A, B, and C, (irtiich, 
in the context of the present discussion* can be thought of as three 

separate testii). For each student, the total predicted score is the 

\^ 

sum of one obsei*yed sdore (for Part A) and two predicted scores (for 

. \ 

Parts B and C). TThe maximum score fof^^^^t A is 7f that for Parts B 
and C, 35, yielding\ total maximi®/ score of 77.' Let 

T(A) be the ol^^erved score on Part A, 

T(B) be the predicted score on Part'B, and 

T(C) be the predicted score on Part C. 

/ 
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Then the, total score, T, is the sum 6f these three, 
T = T(A) + T(B) + T(C). 
Kleinke's method was used to estimate scores for Parts B and C. 
To obtain T(j)., j = B or C, let 

X' be the score on the form the student took, ^ 
X be the mean score on this form, 
Sx be 'the standard deviation on this form, 
Yt b^. the sum of the means of the other 4 forms, taken as an 
estimate of the mean of a composite cqnsijiling of the other forms, 

St b^ the •square root of the sum of the 4 variances, taken as 
an estimate of the standard deviation pf/the other forms, and 
•Y' be .the total predicted score for the other forms, 
^JS!i\en a student's estimated score on Part j is shown in Equation (1). 

\ 



(1) ^ 



T(j) = X+Y'sX+Yt+ (X - X) 

Sx 



Equatlorfd ) is obtaine,d from the regi-easion equation for 

X and Y, \^ 

— SY - 
Y' = I + r (X - X) , J 

SX / 

where r is the correlation between X and Y. If we assume 

perfect correlation between X and Y (r s 1) we obtain Equation 

I 

(!)• If we assume no correlation between X and Y (r = 0), 
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then Y' s', Y, and * ' ' 

T(J) « X + Y , (2) 
These two equations yield upper and lower bounds for predicted scores, 
depending oh the value of r and' on the sign of (X - X). 
(If X • X > 0 then Equation (1) is the upper bound and Equation (2) 
the lower bound.) 

The means and standari^^evlatiqns obtained for predicted t 
total-*test scores (T) for the 1974 achievement test, oaldulated using 
Equatioris (1) and (2) are shown in ^e table below. ^ 

Table 

Means and Standard Deviations for Predicted Totkl^-test Scores 

Equation 1 ^ Equation 2 
Mean ' 37.61 37.61 

S.D. 125.17 23.97 ' 

The small variance resulting. from the application of 

equation 2 reflects the use of only mean scores in the composition 

\ ' . ^ . 

of the total<»test score. 

X 
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^APPENDIX D \ 
Terminal Curriculum Objectives for First Grade 

\ 

Two types of objectives are identified, minimal and advanced. 

\ 

Minimal objectives are to be attained by all students, advanced 

objectives guide curriculum development of topics beyond the minimal 

level. Some objectives guide curriculum development but are not testable 

with the group pencll-and-paper testing procedures u^ed by the project^ 

to evaluate achievement. 

« « 

The following list identifies objectives as minimal (M) or 
advanced (A) and as amenable to test using our procedures (T) or not (N). 
Objectives are identified by strand. The objectives .are described u 
(starting on page 4. In describing addition and subtraction exercises, 



lower 


case letters are used to 


represent single digits. 




Strand 


/ 

Description/ 


Minimal or 
Adveinced 


Testable 


NUM-1 


^ Rote counting by ones 


M 


N 


NUM-2 


Rote counting by twos 


A 


N 


NUM-3 


Rote counting^ by fives 


A 


N 


NUM-4 


Rote counting by tens 


M 


N 


NUM-5 


Rote counting bacvrwards 


A 


N ' 


NUM-6 


Reading numerals 


M 

* 


N 


NUM-7 


Selection of numeral 


M 


T 
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strand Description Minimal br ' Testable 

Advanced ' ' * 



' ■ NUM-8 Writing numerals M j. /t 

. • 1 

NUM-9 Successors, oral stimulus' * | '^^ 

Successors, Drin ted* stimulus M I \ T 

1 \ 

NUM-11 Predecessors, oral stimulus- A T 

NUM-12 Predecessors, printed stimulus A ' T. 

NlM-13 Counting M * . i T 

Counting a specified subset A ,.T 

NUM-15 Counting the complement of a A ^> , . T 

. ^. specified set ^ ^ 

NUM-16 Greatest and least i M " * f 

. NUM-17 Completing sequences A ^/ T 

NOM-18 Ordinals . M ^ T 

NUM-19 Reading number words A ' - . 

NUM-20 Selecting number words A T 

NOH-21 Writing number words A. T 

NUM-22 Fractions, identification M ^' T 

NUMy23 Fractions, discrimination K T 

ADD-1 Addition, oral stimulus M t 

ADD-2 Vertical addition M T 

ADD-3 Horizontal addition M ^ c T 

ADD^n Horizontal addition, A ^ ' T 

noncanonical format 

SUB-1 Subtraction, oral stimulus , M T 

SUB--2 Vertical subtraction M T 



strand Description 



Minimal or 
Advanoed 



SOB-3 
MEA~1 
• APL-1 
, APL-2 
APL-3 

APL-5 
APL-6 
APL-J 
APL-8 
APL-9 



/ 

Horizontal subtraction^.. 
Length,* cm. 

/ 

Money, identification 

/~ 

Money, value*/ 

Time, hours / 

i 

Time, days p^f week 

/ 

Time successors of days of 

week ^ 
Word problems, addition 

/ 

Word problems, subtraction 
Word problems, multiplication 
Word problems, division 



M 
M 
M 
M 
A 
A 
A 
M 
M 
A 
A 



I > 
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Objectives For First Grade 



NUM-1 /.Rote counting by ones. 

When asked to count aloud, the child will count, "one, two, 
three,..." until stopped (no farther than 100). 



NUM-2 Rote counting by twos 

When asked to count aloud by twos, the child will count, 
"two, four, six,..." until stopped (no farther than 20). 



NUM-3 Rote counting by fives 

When asked to count aloud by fives, the child will count, 
"five, tgn, fifteen,..." until stopped (no farther than 50). 



Rote counting by tens 

When asked to count aloud by, tens, the child will count, 
"ten, twenty, thirty, ..."' until stopped (no farther than 100), 

\ 

NUM-5 Rote counting backwards 

When asked to count backwards from ten the child will . 
count, "ten, nine, eight ,one." 



NUM«-6 Reading numerals 

Given a printed numeral (0 to WO) tli^ child will say aloud 
the name of the number. 

Example: "What" number is this?" 

l|8 
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NUM-7 Selection of numeral 

Given a aet of 2 to 10 printed numerals (0 to 100) and the 
oral instruction to select a specified numeral the child will 
indicate the correct numeral by pointing or circling. 

Example: "Cir6le the 41" 

58 0 4 41 40 14 

NUM-8 Writing numerals 

Given an oral instruction to write a specified numeral 
(0 to 99) the .child will do so. 

Example: "Write the number 87." 

NUM-9 Successors, oral stimulus 

When asked to produce the number that follows a specified 
number (1 to 98) the child will give the correct response 
orally or as a numeral. 

Example: "What number comes after 32?" 

Example: "Write the number that comes after 59 •" 

NUM-10 Successors, printed stimulus 

Given a printed numeral (1 to 98) and the oral instruction 
to write the successor the child will do so* 

Example: "Write the number that comes after this one, 

NUM-11 Predecessors, oral stimulus 

When asked to produce the number that comes before a 
specified number (2 to 99) tVie child will give the 
correct response orally or as a numeral. 

Example: "What number comes before 20?" ' 

Example: "Write the number that comes before 8." 
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NUM-12 Predecessors, printed stimulus 

Given a printed numeral (2 to 99) and the oral instruction 
to write the predecessor the child will do so. 



Example: "Write the number th^ com§^be/oi:;e this one." 




NUM-13 Counting 

Given a set of up to 50 small similar objects (such as 
pencils, beans, or bottle tops), or a drawing of a set of 
similar objects (such as balloons, cows, or cars), and an 
oral instruction to count, the child will say or Write the 
number of objects in the set. 

Example: "Count the baseballs." 

(appropriate picture) 

NUM-14 Counting a specified subset 

Given a set (or a jSicture of a set) of up to 50 similar 
objects containing a subset of up to 10 objects aistinguished 
from its complement by a characteristic that can be recognized 
by the child, and an oral instruction to count the object with 
the distinguishing characteristic, the child will say or write 
the number of objects in the subset. 

Example: "Count the marbles, that have spots." 

(appropriate picture) 

» 

NUM-15 Counting the complement of a specified set 

Given a set (or a picture of a set) of up to 50 similar 
objects containing a subset of obje6ts distinguished from 
its complement by a characteristic that can be recognized 
by the child, with the complement of\the subset containing 
no moi/e than 10 objects, and the oral\instruction to count 
the objects that do not have the distii^guishing characteristic, 
the child will say or write the number pf objects in the 
complement of the subset. 

Example: "Count the clowns that do not have hats." 

(appropriate picture) 
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NUM--16 Greatest and least 



Given a set of 2 to 5 printed numerals (0 to 100), and the 
oral instruction to select the greatest (or least), the child 
will indicate the correct choice by pointing or circling • 

Example: "Point to the least number." 

25 2 52 11 



NUM-17 Completing sequences 

Given a printed arithmetic sequence of 4 to 8 numbers, with 
the characteristics described below, and with any number other 
than the first replaced by a blank line, the child will write 
.the missing number. 

♦ 

Incremental Starting number of Limits on numbers 

difference form (k an integer) 

1 k 1-100 

2 2k 2-20 
5 5k ^ 5 • 50 

10 10k 10 - 100 

-1 k 10-1 

Example: "Write the missing number." 

iL6 JO 

NUM-18 Ordinals 

Given an ordered set (or picture of an ordered set) in which 
there is an unambiguous first element and ordering (i.e., the 
child can identify the first element, the next, etc.,), and 
an oral instruction to select the second, third, fourth, fifth 
or sixth object, the child will indicated the correct answer 
by pointing or circling. 

Example: "Circle the fifth person in line," 

(appiropriate picture) 



NUM-19 



Reading number words 



Given a printed name for a number from one to ten the 
child can read the word aloud. 



NUH*20 Selecting nui^ber words 

Given a set of number names (1 to 10) and an oral instruction 
to select a specified word, the child will indicate the correct 
choice by pointing or circling. 

Example: "Circle the word five,"^ 

ONE FIVE FOUR THREE 



NUM-21 Writing number words 

Given the oral instruction to write the word for a specified 
number between one and ten the child can do so. 

Example: "Write with* letters the word eight," 



NUM-22 Fractions, identification 

Given a set of figures divided into 2^^^ or 5 equal partsy^ 
the child will indicate by circling o^^inting the figure 
that is divided into halves, thirds, or fourths. (Figures are 
divided by horizontal or vertical* lines and all parts are of 
equal size and shape.) 

Example: "Circle the figure that is divided into thirds." 

(appropriate picture) 



NUM-23 Fractions, discJ-imination 

t 

Given a pair of figures one of which is divided into 2 (3,^) 
equal parts and the other into 2,(3,4) unequal parts, the 
child will select the one that is divided into halves 
(thirds, fourths). 

Example: "Circle the figure that is divided into thirds." 
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ADD^I Addition, oral stimulus 



Given an ac^dition exercise presented orallyi, of the 
specifications described below, the child will produce the 
sum orally or as a printed nmieral. (Recall that lower case 
letters represent single digits, e.g., aO is k multiple of 
10 less than. 100, etc.) 



Exercise description 
a + b 
aO 4- b 
ab + 1 

a + b + c, a + b <= 10 



Example 

"Write the sut^ of 6 and 7." 
"What is 20 plus 8?" 
"What is 28 plujs 1?" 
"What in 4 plus 5 plus 8?" 



ADD-2 Vertical addition 

The child will write the correct answer for an addition exercise 
presented in vertical format for any of the following classes of 
exercises. 



Exercise descrlptioji 
a 

4- b 



ab 

■I- c 

ab 
-fcd 

a 
b 

+ c 



b + c <= 9 



a + c <= 9 
b + d <= 9 

a + b <= 10 



Example 
6 

±Ji 
23" 

17 
4-62 

2 
5 

±_i. 



t 
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ADD-3 Horizontal addition 

The child will write .the corrfect answer to »an addition 
exercise presented in horizontal format for any of the 
following classes of exercises. 

Exercise description Example 

a + b = 5 + 9 = 

aO + b = / ' 70 + 2 = 

ab + 1 = 36 + 1 = 

^ a + b + c* s , a + b<=10 7 + 2 + 5= 

Horizontal addition, noncanonical format 

Given a written exercise of the form 

a\+ = b or + a = b 

and the oral instruction to supply the missing number 
the child will .write the missing addend. 

Example: "^Write the missing number." 

6 + _ = 9 

SUB-1 Subtraction, oral stimulus, 

» ' Given a subtraction exercise presented orally, of the 

specifications described below,, the child will produce the 
correct answer orally or as a printed numeral. 

Exercise description Example 

a - b "How much is 7 minus 3?" 

ab - b "Write the difference, 23 minus 3*" 

ah - 1, • "How much is 25 minus 1?" 
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SUB-2 Vertical subtraction 

The child will write the correct answer for a subtraction 
exercise presented in vertical format for any of the following 
classes of exercises. 



Exercise description 



a 

ab 

^ c. 

ab . 
-cd. 



b >s c 



b >= d 
a >= c 



^Exam01e 
4 

26 
- 6 

65 
-22 



SUB-3 Horizontal subtraction 

The child will write the correct answer to a subtraction 
exercise presented in horizontal format for the following 
exercise class. 



Exercise description 
a - b = 



Example x 
9 - 2 = _ 



MEA-1 Length, cm 



Given a ruler marked in centimeters and an object that is 
1 cm, 2 cm,..., or 10 cm, in length, the child will measure 
and give orally or as a numeral the correct length. 



AjPL--! Money, identification 

Given a set (or picture of a set) of up to 4 coins or bills 
(of no greater value than 100 cordobas), and the oral 
instruction to choose the coin (bill) of a specified value, 
the child will indicate the correct response by pointing or 
circling. 




\ 



APL-2 Money, value 

Given a set of coiria or bills conforming to the specifications 
given below, the child will write the combined value as a 
numeral * . 

For bills, sums are of the form A + .B, D + B, and A +\B ^ C 
where A, B, C are chosen from the set :1, 2, 5 cordobW: 

and D is chosen from the set :10, 20, 50 cordobas: \ s 

1 \ 

\ 

for coins, sums are of the form A + B and C + A, where A,. B 
are chosen from the set :5, 10 centavos: and C is 50 centa^vos, 

• \ 

APL-3 Time, hours , > 

Given pictures of three clocks showing time to an even hour, 
and Bn oral instruction* to select the clock that shows a 
specified time, the child will indicate the correct choice , 
by pointing or circling. 



APL«*4 Time, days of the week 

When asked to recite the days of the week the child will 
respond , *^Monday , Tuesday f . . . Sunday * ^ 



APL«^5 Time, successors of days of the week 

When asked for the day that follows a specified day, the child 
will give the correct response orally. 

/ 



9 

APL-6,7,8,9 Word problems ' \ 

Not written yet. 
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• APPENDIX E 
Materials for Lesson 18 

This appendix contains the following materials for Lesson 
18 in the order given here* 

Curriculum Outline 

A description of the mathematical contents of 
the lesson » / 



Notes to Script ijfriters , * / 

I ' * 

Directions to the script writers about specific 
wording of instructional material 



Student Worksheet 



Ratdio Script j * ^ 

«^ Script as prepared TTor recording artists 



/ 



Teachers' Guide . 

Guide to the postbroadcast activities \ 
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Nota^^al escrltor de libretos 



"^CuSnto es 2 m$s 2? (P) Vamos a probar que 2 tnS^ 2 son 4.. 
Pongan 2 tapas en una mano y 2 en la otra... 2 tapas en una 
mano y 2 tapas en la otra mano. Pongan las manos juntas. 
iCuintas tapas hay por todo? (P) s!^ 2 mSs 2 son 4.^ 



"^Busquen la bandera que tiene la bola, Pongan un dedo en la 
bandera que tiene la bola. En ese cuadro escrlban el ndmero 4* 



"Busquen el- dado que tiene el ^rboVr_£ongan un dedo afif. 
Ahora voy a preguntarles acerca de los nOmeros que van des- 
puSs de Qtros. ' Ftjense si tiene el dedo sobre el dado que 
tiene el £rbo1. No lo quiten porque en ese cuadro van a es* 
cribir un nCmero. Dfganmev nGniero va despuSs del 2? (Pausa) 
Escrlban en (sl cuadro el ndmero que va despufis del 2."' 

^ • ' *• 

"Busquen la chimbomba que tiene un banano. Pongan. un dedo 
en la chimbomba que tiene un banano. En ese cuadro hay dos' 
Ifneas-de puntos. Sobre la primera Unea de puntos dibujen 
tres rueditas (P) Ahora dibujen dos rueditas sobre la segun- 
da Ifnea de puntos. |(P) Miren todas las rueditas que hay 
en ese cuadro. Ofganme, ^Cu£ntas rueditas hay por t^do?" 
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TEMA MUSICAL 
FUNDE A 

MUSICA TIPICA CON APLAUSOS Y MURMULLO - ESTUDIO 

LOBO; (anunciando) Atenci6n.., Vengan todos a divertirse a la, gran 
fiesta... 

MUSICA SUBE Y QUEDA A FONDO ^ ^ 

LULU : (rte a carcajada) iQuS alegrel ?Qu6 alegrel 
LOBO : (llama retlrado) Lu1(i, Carlos, vengan. Vengan con los nlilos. 
' ^ (retirado anuncia) Ventas, juegos... 

iVa a comprar, ami go? 
CARLOS: Ninos, que bueno, van a abrir las ventas. 
LULU : iMira, Carlos, cuantas cosas hayl... 
CARLOS: (interrum|)eJ IHm, que ricp huelel Nacatamales y chicha... 

Mira ahf ej/chicharr6n con yuca... el fresco de cacao, mangos 

y jocotes. {QuS ricol 
LULU : IAy> cuantas maracas y munecas! Ay, iquS lindas! 5, 9, 11,... 

20 (exclamacifin) IQuS montfin! Compremos^ compremos. 
CARLOS : Mira, Lulfl., 
LULU : El lobo, cuantas cosas trae. 

LOBO: Hoi a amigos. Miren, miren todo lo que me dieron... por andar 

trabajando en la barata..^ Pero no sS cuantas son. 
CARLOS: Ensena, lobo. Ensena. Ah, cuintas son. 
LOBO: CuSntalas, Carlos. 
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LULU: 
LOBO: 



Que los ninos las cuente, Carlos. 



Entonces, que me ayuden los ninos porque mfra, prfmero me 



diercn dos chlmbombas y despuSs me dieron tres.,. Bueno, yo 
creo que dos mSs tres son.v. cinco. 

MUSICA SALE 

CARLOS ; Espera, probemos si es verdad. Atenci6n, nlRos, Con una 

mano muestren dos dedos y con la otra muestren tres, AjS» 

•» 

iCuSntos dedos son? (PAUSA) Eso es, porque dos mJs tres son 
cinco. dY qug.,* mSs te dieron, Lobo? 
LOBO: (inquieto) Ay» ay... miren, me dieron dos caramelos y despuSs 
otros dos. 

CARLOS: Ninos, dfganme. ^Cu^nto es dos mJs dos? (PAUSA -2) Eso es, 
cuatfo. Pero vamos a probarlo. Con una mano muestren dos^ 
dedos... y con la otra muestren dos^mSs... Ahora dfganme, 
dCuSntos dedos son? (PAUSA -2)- Muy bien, dos mSs dos son 
cuatro. 

LOBO: Ah, tambiSn me dieron candelas romanas. Primero me dieron 

tres y despuSs dos. 
CARLOS: A ver ninos, icuinto^ es tres mSs dos? (PAUSA -2) 

Ahora ,^vamos a probar con los dedos. 

Con una mano muestren tres dedos, y con la otra mano muestren 
dos mSs... Bien, icuJntos dedos son? (PAUSA -2) 
Eso es, porque tres mSs dos son cinco. 
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LOSO: AjS, candelas romanas. TambiSn me dieron gorras. Primero 

me dieron cuatro y despuSs una. 
C ARLOS: A ver nifios, icuSnto es cuatro mJs uno? (PAUSA -2) 

Ahora probemos. Con una mano ifiuestren cuatro dedos y con 

la otra muestren un dedo. iCuSntos dedos son?.. (PAUSA -2) 
LOBO : Y miren me dieron banderas. Ay> pero poquitas. Primero 

me dieron yna y despuSs dos. ^ ' 

CARLOS; Nifios, ^cuSnto es una mSs dos? ' (PAUSA. -2) 

Ahora a probar. Muestren un dedo..; aj$, con la otra mano 

muestren dos. iCuJntos hay por todd? (PAUSA -2) Eso es, 

uno mis dos son tres. 
LOBO: Que bueno, tres banderitas. . . IToma Lulfi, una para tf, una para 

Carlos y la otra para mf... Cuantas cosas me dieron... 

Pero vengan... vamos allS.^. ahf van a ser las carreras de 
. caballo. • * 
LULU: Ninos> tambiSn van a haber carreras... Vamos, vamos!.. 

PUENTE MUSICAL 

SONI-DO : FERIA QUEDA A FONDO (VOL.- 1040-B-19) ^ 

tODOS: iCuSntos caballosl (en tono bajo) Uno, dos, tres, cuatro. 

LULU ; Mejor contemos con los ninos. 

CARLOS : Ninos, contemos. 
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SONIDO PALO (PREC A CONTEO) /. * 

CARLOS ; Una, dos, tres, cuatro, cinco, sels, slete, ocho« nueve,- 

diez, once, doce, trece, catorce, quince... dieciseis. ' 
dieclslete... diecioqbo... diecinueve... velnte. 

LOBO y CARLOS ; (rfen) Se movieron, Carlos. 

CARLOS ; Son veinte. Pero volvamos a contarlos. Nines, contemos otra vez. 

SONIDO PALOS; 

Uno, dos, tres, cuatro, Cinco, sejs, siete, ocho, nueve, diez, 

once, doce, trece, catorce, quince... diecisels... d4ecisiete... 

dieciocho... diecinueve... veinte. 
LULU; AjS, son veinte caballos. (con asopibro) Y todos los caballos 

tienen nCmeros. Mira van a mostrarlos. 
CARLOS : Aht va el cinco. » 

LOBO; Y £cuS1 va despuSs del cinco? 

CARLOS; Atencifin, ninos, dfganle al lobe que ndmero va despuSs del cinco. 

(PAUSA -2) 

t-OBO ; AjS, el seis. Pero mira ahf traen el ocho. 

CARLOS; Ninos, iquS ndmero va despugs del ocho? 

(PAUSA -2) Eso es, despuSs del ocho va el nueye . 
LULU ; Mira, aho/a traen el siete. 

CARLOS; St, es cierto. , Ninos, iqu5 ndmero va despugs del siete? ^ 

(PAUSA -2) 

LOBO; AjJ, despuSs del siete, va el ocho... Y ahora traen el nueve. 



LOBO 



tULU 



LOBO 
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CARLOS; Niflos, iquS nOmero va despuSs del nueve? ■ (PAUSA -2} Eso es, 

despuSs del nueve va el diez . 
LULU ; Ahora sT, traen el diez. v 

CARLOS ; Vambs, nlRos, iqug nOmero v.a despa'^s del diez? (PAUSA -2) 

Eso es, despuSs del diez va el once. 
(triste) Ya no trajeron mSs. iQuS serl? 
Es 'que^sW sbn lbs que^v^^^^ 
Entonces, vamos a ver las ruletas, 
^ CARLOS ; Sfl vamos a las ruletas. 

SONIDO FERIA SUBE Y QUEDA A FONDO 

LOBO ; . Las ruletas, Carlos. Las ruletas tambiSn tienen nfimeros. 

Juguemos. 

CARLOS: ST^ juguefiios, pero que los niRos jueguen tambiSn. 

LULU; ST, que los nifSos nos 11 even la cuenta de los nfimeros en que 

vamos a jugar. * * 

LOBO : :■ ^ Y, ic6mo LulC? 

SONIDO FERIA SALE • , * 

LULU; Veris, Lobo* Ninos, tomen todos su hoja de trabajo. Busquen 

I la cara que tiene su nombre. (PAUSA -2) En esa cara es donde 

vamos a trabajar. Busquen las banderas... Pongan el dedo sobre 
la bandera que tiene la bola de belsbol. (PAUSA -2) 
Toijien su ISpiz. En ese cuadro escriban el nfimero cuatro. 
(PAUSA -8) 

Bajen el dedo a la bandera que tiene el pajarito > (PAUSA -2) 
En ese cuadro escriban el nfimero tres, (PAUSA -8) 
Sigamos. Bajen el dedo a la bandera que tiene la hoJa > (PAUSA -2) 
En ese cuadro escriban el nflmero cinco. (PAUSA -8) 



ERIC 
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Ahora, bajen el dedo a la bandera que tiene la flor > En ese 
cuadro escrlban el nClmero dos, 
(PAUSA -8) 

Bajen el dedo a la bandera que , tiene el zapato . En ese cuadro 
escrlban el nCimero' seis > ^ 

(PAUSA"^-8r^ ^ 

Ya, LulG, sfilo jbsos nflmeros van a jugar. 

Bien. Ninos, sigamos. Busquen los dados > iLos ven? (PAUSA -2) 
Ahora, busquen el dado que tiene el Irbol , (PAUSA -2) En ese 
cuadro escriban el ndmerp que va despuSs del dos. (PAUSA -8) 
Ahora, bajen el dedo al cuadro donde estS el dado con la casita_... 
En ese-cuadlro escriban el riOmero que va despuSs del uno. (PAUSA -8) 
Sigamos, bajen el dedo al cuadro donde estS.el dado' con el ISpiz . 
Escriban el nCmero que va despuSs del cuatro. (PAUSA -8) 
Ahora, bajen el dedo al cuadrp que tiene, el dado con un martillo . 
Escriban el numero que va despuSs del tres. (PAUSA -8) 
Bajen el dedo al cuadro donde estS el dddo con una mano. 
Escriban el nOmero que va despuSs del uno. (PAUSA -8) 
Ya, Carlos. Ya t^rmi namo's con los dados. 
Ahora vamosxon la otra parte. • . 

iCuSl parte, LulG? 

Con e^ta, Lobo. AquT donde estSn las mesas. Ninps, ustedes 
tambiSn busquen las mesas. La primera tiene un plato. iLa ven? 
Aho**ai dfganme. iQuS hay en la segunda mesa? (PAUSA -2) 
Entonces encierren en un cfrculo la primera mesa. (PAUSA -5) 
Ahora, vamos al otro cuadro. Hay unas canastas . En la primera 
hay sandfa. Y en la segunda . iquS hay? (PAUSA -2) 
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NiRos, encierren la segunda canasta. (PAUSA -5) 
Vamos a las cajas. Encierren la segunda caja. (PAUSA -5) 

Y ahora, vamos a los platos. iLos ven? (PAUSA -2) 
Encierren el primer plato. (PAUSA -5)- 

Y temiinamos con esa parte — 
SONIDO FERIA SUBE 

LULU; Y el Lobo, id6nde estS^-** Lobo, ven. Sigamos trabajtndo... Se 

le olvid6 que estaba trabajando. 



LOBO; 


(retlrado) No> Lul(i> no se me ha olvldado. 

Es-que aquT vaa a bailar. (rfe) Y yo quiero bailar. 


FUNOE A 




MUSICA TIPICA 




CARLOS: 


No, LCbo, primero vamos a terminar con la hoja de trabajo. 
Ven» ven* , 


LOBO: 


(aproximJndose) iX qu5 vamos a hacer? 


CARLOS: 


♦ * 
Ah, ahora vamos a dibujar. 


LOBO: 


No... eso sT que yo no puedo. Dibujar no puedo, Luld. 


LULU: 


Ay» Lobo, si es bien fScil. VerSs que bien dibujap los niffos. 


LOBO: 


^D6nde estSn las chimbombas? 



• MUSICA Y SONIDO SALEN 

LULU ; ST» Lobo. Ninos» busquen las chimbombas . Ahora» busquen la 

chimbomba que tiene un banano ... Pongan el dedo sobre esa 

chimbomba (PAUSA -2) Ffjense. En ese cuadro hay dos Ifneas 

'I 

de puntos. Bien, sobre la primera ITnea dibujen dos rueditas. 
A (PAUSA -12)* 
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Ahora, en la segundailTnea dibujen una rued Ita mSs, (PAUSA-12) 

Mirerj blen todas rueditas,- (PAUSA -.2) 

Dfganme, icuJntas rueditas dlbujaron en ,ese cuadro? (PAUSA - 2) 

Sigamos, bajen el dedo a la chimbomba que tiene el machete^ ^ 

En ese cuadro hay tambl^n dos ITneas de 'puntos. En la primera ITnea 

dibujen .una ruedita. (PAUSA -12)* Ahora en la se^nda Ifnea 

dibujen tres . (PAUSA -12) DTganme, icuSntas hiy por todo? 

Bajen el dedo ahora a la chimbomba que tiene* el sorbete. En la 

primera ITnea dibujen tres rueditas > (PAUSA^-12) Ahora, en la 

segunda ITnea dibujen dO£ mas, (PAUSA-12) DTganme, icuSntas 

dlbujaron por todo? (PAUSA - 2) . ^ 

Ahora,' bajen el dedo a la chimbomba que tiene la p1na«.« En la 

primera ITnea dibuje^dos rueditas, (PAUSA -12) Y en la segunda 

ITnea otras dos.^ (PAUSA -12) 

^CuSntas dlbujaron por tci^o? (PAUSA -12) 

c 

Y terminamos con la hoja.de trabajo. 
LOBO ; Ahora sT puedo-seguir viendo bailar. 

CARLOS ; ST, vamps a ver bailar. " ' 

SONIDO.FERIA REPITE 



LULU 



LOBO 



LULU 



Mejor vamos a montarnos a los cabal litos. 

AjS, ahT estin todos mis amigos. Pero no me' vuelven a ver, 

1(V1endose) C6mo te van a volver a ver si son de palo, ven. 



Vimos, Carlos, 
SONIDO: MUSICA CABALLITOS (VOL, 1017-B-l) 
TODOS; (RIEN) 
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CARLOS; 
-LULU: 



LOBO: 



LULUi 



LOBO: 
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CARLOS y LULU 

1 

SONIDO SI|BE - 

FUNDE A 

TEMA MUSICAL 



ApQrate. LulC... Dame la mano. Sube> sube. 

ST..., pero -yo agarro este caballo que va muerto de la risa* 

(rfe) Ven, Lobo, agarra^tG el torp. 

IHo me cornea? 

fen) SI no hace nada. 
(lucha por sublr) No puedo, no puedo. Ay nie escurro. Me voy 
a caer. Aytidenme. ' 
No te caes» agirrate blen. - 
(rl^n) , ^ ' 

(rte a carcajadas) Va al revfisv^Carlos, (rfe) NIRos^^l lobo 
se mont6 para atrSs* 

Ay mamlta. Todo da vuelta, Dios mfo,,, por*d6ndp voy... 
Parent.pcTparen.. . 

(rfen) . " 
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' * Gui'a del Maestro /' ? • 

/' ■ ^ • • 

Materialesj *\ ^ ■ 

- Hoji de trabajo 18, taroctac, 'con .nunerales de 1 
^ a 9i material concreto: '10 ol^oetos. 
Activxdades: ^ ^ ' 

Antes de ila trahsmisitSn . / - . . 

• Distribuya las hojas de traba^o W 18. 

Diga.a los niiios que ^scriban su non^e y n^'^ero. 

Active "lsl| grabadora. * , s 

Despu^s de la trans!nisi6n . * ^ 

Diga a los ninos: ' " t • 

Ahora trabajaf emos en la segxinda cara de la hoja do 

trabajo. ' ' ^ . 

*~-r Leer nuraeralos de 1 a 7 X encerrar uno. 

"Obsorven el cuadrito que tiene palorjota coii pajkrito 
iQue nuaeros hay en ose cuadro?" * , | * 

* "Lean conmigo esos niimeros."- ' i 
Vean los dem^s cuadros. \' ^ ! 

iTodos tiene. los mismSs ntSmeros? > | • 

Pongan un dedo en el cuadro que tiene paaaritouj;, de ' 
los huner.os jde ese cuadro, encierren en un cfrcUlo el 

3- V ^ ' j 

Ea' el cuadro qye Ijiene p^lometa con banano, encierreji 
el 6. , ^\ ^ \ 

DQnde esta-la palometa con hoja, encierren el 2. 
^ ^ el cuadro de la'paXometa con bola, encierren el ^. 

En el cuadro de palometa con so: bete-, encierren el 

En el cua,a:P?o de palQlneta con pifia encierren el 5« 

Recoja las hojas de trabajo. 

Leer nmerales de 1 a 9 con-tarjtetas. % 

a manera de adivinanza presente a los ni^os las tar- 

jetas ppr el lado quo no* tienen ntinero y diga por 

eaemplo: "Carlitos ajlivina, ^tie niSmero. hay en esta 

taroeta*^' v ' - •> * 

Dele vuelta a la-tarjota y pregunte a los niiios^ 
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iQuS nlinero es? iAdivind Oarlitos? 

Continue eX fejercicio con las dends tarjetas del 1 

Oonteo cardinal del 1 a 10. con material, concrete* 
Coloque en su hesa 10 objetos que sean visibles por 

todos ios'ninos, ' ' > 

Seleccione un nino y que pase a contar los objetos 
y los ubique en otra posici6n y que los demfis ninos 
repxtan con 61 el conteo* 

Repita el ejercicio las veces que estine' conveniente 




ido- al nino que cuenta los objetos. 



0 




, APPENDIX F 

\ I ■ 

Des.ign of Embedded Tests 
• * i • 

Tests are* Included ot regular intervals in the mathematics 
cm^riculuffi. These embedded test s have two purposes, to provide 
information to curriculum developers on the attainment of curricular 
objectives, and to provide the raw data^for analysis of the progress 
of individual stuaents through the curriculum. For the second purpose, 
it is important to have a measure of student progress that can be 
used to make comp';(]||'isons bet^ween students. - 

To provide the basis for such a measure each instructional 
class is assigned a levfel number, the number of the lesson in which 

the class is first used. Items for each embedded test are selected so 

A- 

*th^t the mean level of the instructional classes of which the items 

are exemplars is 80 percent of the number of the lesson containing the 

test. For Example, the mean level number of the classes represented 

in the test in Lesson ^^ is 32.8. With, this method of item choice, 

the student test score, T, (defined below), has the property that if a 

student answers all items correctly over a series of tests, T increases 

linearly over the test series. 

In order to describe the process of constructing an embedded 

test we need the following definitions. 

^ I ^ ' 

DEF. Level of a class : The level of a class is the number of the 

lesson in which the class is first used. (Lessons are numbered 

cop^*^%vely starting with the first taped lesson.) 
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DEF. . Testable class ; - At Lesson N a class jis testable if 

! \ 

1. The level of the class is less thani or ec^pal to N, i.e. the 

■■ \ 

■ class has been' used by the end of Lfesson Nu 

2. Exercises from this class have been! administered by radio 
(not only by teachers) by the end of Lesson N. 

3. Student responses to the exercises iare writter^. 

' ^. The class content represents a curriculum ^oal^ not an 



interm'ediate objective. \ . 

\ 

5. The task is independent of context, e.g. does not depend on 



preceding exercises. / \ 

- ' - ' \ 

\ 

DEF. Active strand ; A strand is, active If it contains at\least 

3 testable classes of level less than or e^qual to N. 

\ 

j \ 
An embedded test is included in every fifth lesson, in -Lesson 

N + 1 where N is greater than or equal to 20 and divisible by 5;. 

I 

To construct a test to be embedded in Lesson N + 1 do the follov^ing: 

1. From each active strand, select all testable classes lof 

t 

level greater than or equal to N/2. t 

2. "Select 10 classes such that ' 

a. the mean class^ level is 80 percent of N, i 

b. active strands are represented acc6j^ding to the 
distribution displayed in Figure C2 (in text), 

c- the spread in class level is relatively large within 
each strand. 

3* From each class tb be tested, select a test iteri) that fairly 



represents the class, i.e. is neither the easiest nor hardest 

exercise .in the class, if there is any difference in difficulty. 

Step 1 restricts potential items to the more recent half of 

the curriculum. Because of the hierarchical nature of the mathematics 

curriculum, later instructional classes subsume the. content of most 

earlier classes, and more useful information is likely to obtained 

by sampling later classes. Each test contains ten items (hence the 

requirement for ten classes), a compromise number arrived at by 

balancing the competing goals of obtaining information, and not 

dominating the lesson activities. 

The test score T(s,j) for student s on test j is 

SUM(i=:1,n) X(i) LN(i) 
T(s,j) = 

n : ~ , ' 

where n is Ihe number of items oh test j, X(i) takes on the 
value 0 or 1 for an incorrect or correct response, respectively, 
^to item i, and LN(i) is the level number of the class of which 
item i is an exemplar (or, for short, the level of item i) . 
Note that if the student answers all items correctly T is the mean 
of the level numbers of the items. 

Test scores will provide a measure of progress through 
the curriculum. These measures can be related to information about 
individual students, such as attendence, pretest scores, age, rural 
or urban background, ability grouping within the classroom (if it is 
practiced) and so on, and also to prior performance in the course, 
using either prior test scores or daily worksheet performance. 
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